2024-04-17T14:09:34.890 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-17T14:09:34.891 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T14:09:35.047 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f76ca1d8c10>, signals=[15]) 2024-04-17T14:09:35.047 INFO:teuthology.lock.ops:Start node 'smithi042.front.sepia.ceph.com' reimaging 2024-04-17T14:09:35.048 INFO:teuthology.lock.ops:Updating [smithi042.front.sepia.ceph.com]: reset os type and version on server 2024-04-17T14:09:35.048 INFO:teuthology.lock.ops:Updating smithi042.front.sepia.ceph.com on lock server 2024-04-17T14:09:35.064 INFO:teuthology.lock.ops:Start node 'smithi098.front.sepia.ceph.com' reimaging 2024-04-17T14:09:35.065 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: reset os type and version on server 2024-04-17T14:09:35.065 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2024-04-17T14:09:35.089 INFO:teuthology.lock.ops:Start node 'smithi117.front.sepia.ceph.com' reimaging 2024-04-17T14:09:35.089 INFO:teuthology.lock.ops:Updating [smithi117.front.sepia.ceph.com]: reset os type and version on server 2024-04-17T14:09:35.090 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server 2024-04-17T14:09:35.171 DEBUG:teuthology.provision.fog.smithi042:Requesting image smithi_centos_9.stream (ID 10) 2024-04-17T14:09:35.196 DEBUG:teuthology.provision.fog.smithi098:Requesting image smithi_centos_9.stream (ID 10) 2024-04-17T14:09:35.215 INFO:teuthology.provision.fog.smithi042:Scheduling deploy of centos 9.stream 2024-04-17T14:09:35.219 DEBUG:teuthology.provision.fog.smithi117:Requesting image smithi_centos_9.stream (ID 10) 2024-04-17T14:09:35.240 INFO:teuthology.provision.fog.smithi098:Scheduling deploy of centos 9.stream 2024-04-17T14:09:35.263 INFO:teuthology.provision.fog.smithi117:Scheduling deploy of centos 9.stream 2024-04-17T14:09:35.528 INFO:teuthology.orchestra.console.smithi042:Power off 2024-04-17T14:09:35.528 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-17T14:09:35.542 INFO:teuthology.orchestra.console.smithi098:Power off 2024-04-17T14:09:35.542 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-17T14:09:35.556 DEBUG:teuthology.orchestra.console.smithi042:power off output: Chassis Power Control: Down/Off 2024-04-17T14:09:35.556 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T14:09:35.563 DEBUG:teuthology.orchestra.console.smithi098:power off output: Chassis Power Control: Down/Off 2024-04-17T14:09:35.564 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T14:09:35.577 INFO:teuthology.orchestra.console.smithi117:Power off 2024-04-17T14:09:35.577 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-17T14:09:35.587 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2024-04-17T14:09:35.587 DEBUG:teuthology.orchestra.console.smithi042:check power output: Chassis Power is off 2024-04-17T14:09:35.598 DEBUG:teuthology.orchestra.console.smithi117:power off output: Chassis Power Control: Down/Off 2024-04-17T14:09:35.598 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T14:09:35.622 DEBUG:teuthology.orchestra.console.smithi117:check power output: Chassis Power is off 2024-04-17T14:09:35.688 INFO:teuthology.orchestra.console.smithi098:Power off completed 2024-04-17T14:09:35.688 INFO:teuthology.orchestra.console.smithi042:Power off completed 2024-04-17T14:09:35.724 INFO:teuthology.orchestra.console.smithi117:Power off completed 2024-04-17T14:09:35.789 INFO:teuthology.orchestra.console.smithi098:Power on 2024-04-17T14:09:35.789 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-17T14:09:35.796 INFO:teuthology.orchestra.console.smithi042:Power on 2024-04-17T14:09:35.797 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-17T14:09:35.810 DEBUG:teuthology.orchestra.console.smithi098:power on output: Chassis Power Control: Up/On 2024-04-17T14:09:35.811 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T14:09:35.819 DEBUG:teuthology.orchestra.console.smithi042:power on output: Chassis Power Control: Up/On 2024-04-17T14:09:35.819 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T14:09:35.826 INFO:teuthology.orchestra.console.smithi117:Power on 2024-04-17T14:09:35.826 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-17T14:09:35.835 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2024-04-17T14:09:35.842 DEBUG:teuthology.orchestra.console.smithi042:check power output: Chassis Power is off 2024-04-17T14:09:35.847 DEBUG:teuthology.orchestra.console.smithi117:power on output: Chassis Power Control: Up/On 2024-04-17T14:09:35.847 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T14:09:35.869 DEBUG:teuthology.orchestra.console.smithi117:check power output: Chassis Power is off 2024-04-17T14:09:39.838 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T14:09:39.847 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T14:09:39.870 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T14:09:39.949 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2024-04-17T14:09:39.956 DEBUG:teuthology.orchestra.console.smithi042:check power output: Chassis Power is off 2024-04-17T14:09:39.978 DEBUG:teuthology.orchestra.console.smithi117:check power output: Chassis Power is off 2024-04-17T14:09:43.953 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T14:09:43.961 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T14:09:43.980 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T14:09:44.063 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2024-04-17T14:09:44.070 DEBUG:teuthology.orchestra.console.smithi042:check power output: Chassis Power is on 2024-04-17T14:09:44.088 DEBUG:teuthology.orchestra.console.smithi117:check power output: Chassis Power is on 2024-04-17T14:09:44.164 INFO:teuthology.orchestra.console.smithi098:Power on completed 2024-04-17T14:09:44.171 INFO:teuthology.orchestra.console.smithi042:Power on completed 2024-04-17T14:09:44.188 INFO:teuthology.orchestra.console.smithi117:Power on completed 2024-04-17T14:09:44.266 INFO:teuthology.provision.fog.smithi098:Waiting for deploy to finish 2024-04-17T14:09:44.272 INFO:teuthology.provision.fog.smithi042:Waiting for deploy to finish 2024-04-17T14:09:44.289 INFO:teuthology.provision.fog.smithi117:Waiting for deploy to finish 2024-04-17T14:12:24.542 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:12:27.615 WARNING:teuthology.provision.fog.smithi042:[Errno None] Unable to connect to port 22 on 172.21.15.42 2024-04-17T14:12:33.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:12:36.703 WARNING:teuthology.provision.fog.smithi042:[Errno None] Unable to connect to port 22 on 172.21.15.42 2024-04-17T14:12:42.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:12:45.758 WARNING:teuthology.provision.fog.smithi042:[Errno None] Unable to connect to port 22 on 172.21.15.42 2024-04-17T14:12:51.765 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:12:54.846 WARNING:teuthology.provision.fog.smithi042:[Errno None] Unable to connect to port 22 on 172.21.15.42 2024-04-17T14:12:59.442 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:13:00.848 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:13:03.903 WARNING:teuthology.provision.fog.smithi042:[Errno None] Unable to connect to port 22 on 172.21.15.42 2024-04-17T14:13:09.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:13:17.983 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117 2024-04-17T14:13:23.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:13:27.070 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117 2024-04-17T14:13:33.072 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:13:36.126 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117 2024-04-17T14:13:42.134 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:13:45.215 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117 2024-04-17T14:13:51.219 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:13:54.270 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117 2024-04-17T14:14:00.277 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:14:09.918 WARNING:teuthology.provision.fog.smithi042:timed out 2024-04-17T14:14:15.922 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:14:16.182 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-17T14:14:16.183 DEBUG:teuthology.orchestra.run.smithi042:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-17T14:14:16.499 INFO:teuthology.provision.fog.smithi042:Node is ready 2024-04-17T14:14:16.500 DEBUG:teuthology.orchestra.run.smithi042:> hostname 2024-04-17T14:14:16.514 INFO:teuthology.orchestra.run.smithi042.stdout:smithi042.front.sepia.ceph.com 2024-04-17T14:14:16.514 DEBUG:teuthology.orchestra.run.smithi042:> grep smithi042.front.sepia.ceph.com /etc/hosts 2024-04-17T14:14:16.570 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42 smithi042.front.sepia.ceph.com smithi042 2024-04-17T14:14:16.570 DEBUG:teuthology.orchestra.run.smithi042:> sudo hostname smithi042 2024-04-17T14:14:16.680 DEBUG:teuthology.orchestra.run.smithi042:> sudo sed -i -e 's/smithi042.front.sepia.ceph.com/smithi042/g' /etc/hosts 2024-04-17T14:14:16.711 DEBUG:teuthology.orchestra.run.smithi042:> sudo sed -i -e 's/172.21.15.42/172.21.15.42/g' /etc/hosts 2024-04-17T14:14:16.783 DEBUG:teuthology.orchestra.run.smithi042:> sudo sed -i -e 's/smithi042.front.sepia.ceph.com/smithi042/g' /etc/hostname 2024-04-17T14:14:16.853 DEBUG:teuthology.orchestra.run.smithi042:> sudo hostname smithi042 2024-04-17T14:14:16.923 DEBUG:teuthology.orchestra.run.smithi042:> cat /etc/os-release 2024-04-17T14:14:16.978 INFO:teuthology.orchestra.run.smithi042.stdout:NAME="CentOS Stream" 2024-04-17T14:14:16.978 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION="9" 2024-04-17T14:14:16.978 INFO:teuthology.orchestra.run.smithi042.stdout:ID="centos" 2024-04-17T14:14:16.978 INFO:teuthology.orchestra.run.smithi042.stdout:ID_LIKE="rhel fedora" 2024-04-17T14:14:16.979 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION_ID="9" 2024-04-17T14:14:16.979 INFO:teuthology.orchestra.run.smithi042.stdout:PLATFORM_ID="platform:el9" 2024-04-17T14:14:16.979 INFO:teuthology.orchestra.run.smithi042.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T14:14:16.979 INFO:teuthology.orchestra.run.smithi042.stdout:ANSI_COLOR="0;31" 2024-04-17T14:14:16.979 INFO:teuthology.orchestra.run.smithi042.stdout:LOGO="fedora-logo-icon" 2024-04-17T14:14:16.979 INFO:teuthology.orchestra.run.smithi042.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T14:14:16.979 INFO:teuthology.orchestra.run.smithi042.stdout:HOME_URL="https://centos.org/" 2024-04-17T14:14:16.979 INFO:teuthology.orchestra.run.smithi042.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T14:14:16.979 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T14:14:16.979 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T14:14:16.980 INFO:teuthology.provision.fog.smithi042:Deploy complete! 2024-04-17T14:14:16.981 DEBUG:teuthology.parallel:result is None 2024-04-17T14:15:00.290 WARNING:teuthology.provision.fog.smithi117:timed out 2024-04-17T14:15:06.293 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:15:06.504 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-17T14:15:06.504 DEBUG:teuthology.orchestra.run.smithi117:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-17T14:15:06.845 INFO:teuthology.provision.fog.smithi117:Node is ready 2024-04-17T14:15:06.845 DEBUG:teuthology.orchestra.run.smithi117:> hostname 2024-04-17T14:15:06.861 INFO:teuthology.orchestra.run.smithi117.stdout:smithi117.front.sepia.ceph.com 2024-04-17T14:15:06.861 DEBUG:teuthology.orchestra.run.smithi117:> grep smithi117.front.sepia.ceph.com /etc/hosts 2024-04-17T14:15:06.917 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117 smithi117.front.sepia.ceph.com smithi117 2024-04-17T14:15:06.918 DEBUG:teuthology.orchestra.run.smithi117:> sudo hostname smithi117 2024-04-17T14:15:07.007 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i -e 's/smithi117.front.sepia.ceph.com/smithi117/g' /etc/hosts 2024-04-17T14:15:07.036 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i -e 's/172.21.15.117/172.21.15.117/g' /etc/hosts 2024-04-17T14:15:07.104 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i -e 's/smithi117.front.sepia.ceph.com/smithi117/g' /etc/hostname 2024-04-17T14:15:07.171 DEBUG:teuthology.orchestra.run.smithi117:> sudo hostname smithi117 2024-04-17T14:15:07.238 DEBUG:teuthology.orchestra.run.smithi117:> cat /etc/os-release 2024-04-17T14:15:07.294 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="CentOS Stream" 2024-04-17T14:15:07.294 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="9" 2024-04-17T14:15:07.294 INFO:teuthology.orchestra.run.smithi117.stdout:ID="centos" 2024-04-17T14:15:07.294 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE="rhel fedora" 2024-04-17T14:15:07.294 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="9" 2024-04-17T14:15:07.294 INFO:teuthology.orchestra.run.smithi117.stdout:PLATFORM_ID="platform:el9" 2024-04-17T14:15:07.295 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T14:15:07.295 INFO:teuthology.orchestra.run.smithi117.stdout:ANSI_COLOR="0;31" 2024-04-17T14:15:07.295 INFO:teuthology.orchestra.run.smithi117.stdout:LOGO="fedora-logo-icon" 2024-04-17T14:15:07.295 INFO:teuthology.orchestra.run.smithi117.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T14:15:07.295 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://centos.org/" 2024-04-17T14:15:07.295 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T14:15:07.295 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T14:15:07.295 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T14:15:07.296 INFO:teuthology.provision.fog.smithi117:Deploy complete! 2024-04-17T14:15:07.296 DEBUG:teuthology.parallel:result is None 2024-04-17T14:16:20.765 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:16:23.838 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-04-17T14:16:29.845 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:16:32.926 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-04-17T14:16:38.933 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:16:42.014 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-04-17T14:16:48.021 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:16:51.102 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-04-17T14:16:57.109 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:17:00.190 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-04-17T14:17:06.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:17:09.278 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-04-17T14:17:15.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:17:25.534 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-04-17T14:17:31.538 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:17:34.590 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-04-17T14:17:40.598 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:17:43.678 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-04-17T14:17:49.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:17:50.376 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-17T14:17:50.376 DEBUG:teuthology.orchestra.run.smithi098:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-17T14:18:10.711 INFO:teuthology.provision.fog.smithi098:Node is ready 2024-04-17T14:18:10.712 DEBUG:teuthology.orchestra.run.smithi098:> hostname 2024-04-17T14:18:10.730 INFO:teuthology.orchestra.run.smithi098.stdout:smithi046 2024-04-17T14:18:10.730 DEBUG:teuthology.orchestra.run.smithi098:> grep smithi046 /etc/hosts 2024-04-17T14:18:10.787 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2024-04-17T14:18:10.787 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098 2024-04-17T14:18:10.956 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi046/smithi098/g' /etc/hosts 2024-04-17T14:18:10.986 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/172.21.15.46/172.21.15.98/g' /etc/hosts 2024-04-17T14:18:11.055 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi046/smithi098/g' /etc/hostname 2024-04-17T14:18:11.124 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098 2024-04-17T14:18:11.215 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2024-04-17T14:18:11.229 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="CentOS Stream" 2024-04-17T14:18:11.229 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="9" 2024-04-17T14:18:11.229 INFO:teuthology.orchestra.run.smithi098.stdout:ID="centos" 2024-04-17T14:18:11.229 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="rhel fedora" 2024-04-17T14:18:11.230 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="9" 2024-04-17T14:18:11.230 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el9" 2024-04-17T14:18:11.230 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T14:18:11.230 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31" 2024-04-17T14:18:11.230 INFO:teuthology.orchestra.run.smithi098.stdout:LOGO="fedora-logo-icon" 2024-04-17T14:18:11.230 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T14:18:11.230 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://centos.org/" 2024-04-17T14:18:11.230 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T14:18:11.230 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T14:18:11.230 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T14:18:11.231 INFO:teuthology.provision.fog.smithi098:Deploy complete! 2024-04-17T14:18:11.231 DEBUG:teuthology.parallel:result is None 2024-04-17T14:18:11.458 INFO:teuthology.lock.ops:Checking smithi042.front.sepia.ceph.com 2024-04-17T14:18:11.459 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-17T14:18:11.479 INFO:teuthology.lock.ops:Checking smithi098.front.sepia.ceph.com 2024-04-17T14:18:11.479 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-17T14:18:11.496 INFO:teuthology.lock.ops:Checking smithi117.front.sepia.ceph.com 2024-04-17T14:18:11.496 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-17T14:18:11.514 INFO:teuthology.lock.ops:Updating [smithi042.front.sepia.ceph.com]: set os type and version on server 2024-04-17T14:18:11.514 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-04-17T14:18:11.515 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:18:11.615 DEBUG:teuthology.orchestra.run.smithi042:> true 2024-04-17T14:18:11.797 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-04-17T14:18:11.797 DEBUG:teuthology.orchestra.run.smithi042:> uname -m 2024-04-17T14:18:11.853 INFO:teuthology.orchestra.run.smithi042.stdout:x86_64 2024-04-17T14:18:11.853 DEBUG:teuthology.orchestra.run.smithi042:> cat /etc/os-release 2024-04-17T14:18:11.909 INFO:teuthology.orchestra.run.smithi042.stdout:NAME="CentOS Stream" 2024-04-17T14:18:11.909 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION="9" 2024-04-17T14:18:11.909 INFO:teuthology.orchestra.run.smithi042.stdout:ID="centos" 2024-04-17T14:18:11.909 INFO:teuthology.orchestra.run.smithi042.stdout:ID_LIKE="rhel fedora" 2024-04-17T14:18:11.909 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION_ID="9" 2024-04-17T14:18:11.909 INFO:teuthology.orchestra.run.smithi042.stdout:PLATFORM_ID="platform:el9" 2024-04-17T14:18:11.909 INFO:teuthology.orchestra.run.smithi042.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T14:18:11.909 INFO:teuthology.orchestra.run.smithi042.stdout:ANSI_COLOR="0;31" 2024-04-17T14:18:11.909 INFO:teuthology.orchestra.run.smithi042.stdout:LOGO="fedora-logo-icon" 2024-04-17T14:18:11.909 INFO:teuthology.orchestra.run.smithi042.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T14:18:11.909 INFO:teuthology.orchestra.run.smithi042.stdout:HOME_URL="https://centos.org/" 2024-04-17T14:18:11.909 INFO:teuthology.orchestra.run.smithi042.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T14:18:11.909 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T14:18:11.909 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T14:18:11.910 INFO:teuthology.lock.ops:Updating smithi042.front.sepia.ceph.com on lock server 2024-04-17T14:18:11.938 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: set os type and version on server 2024-04-17T14:18:11.938 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-04-17T14:18:11.938 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:18:12.024 DEBUG:teuthology.orchestra.run.smithi098:> true 2024-04-17T14:18:12.096 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-04-17T14:18:12.096 DEBUG:teuthology.orchestra.run.smithi098:> uname -m 2024-04-17T14:18:12.150 INFO:teuthology.orchestra.run.smithi098.stdout:x86_64 2024-04-17T14:18:12.150 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2024-04-17T14:18:12.204 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="CentOS Stream" 2024-04-17T14:18:12.204 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="9" 2024-04-17T14:18:12.205 INFO:teuthology.orchestra.run.smithi098.stdout:ID="centos" 2024-04-17T14:18:12.205 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="rhel fedora" 2024-04-17T14:18:12.205 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="9" 2024-04-17T14:18:12.205 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el9" 2024-04-17T14:18:12.205 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T14:18:12.205 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31" 2024-04-17T14:18:12.205 INFO:teuthology.orchestra.run.smithi098.stdout:LOGO="fedora-logo-icon" 2024-04-17T14:18:12.205 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T14:18:12.205 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://centos.org/" 2024-04-17T14:18:12.205 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T14:18:12.205 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T14:18:12.205 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T14:18:12.206 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2024-04-17T14:18:12.230 INFO:teuthology.lock.ops:Updating [smithi117.front.sepia.ceph.com]: set os type and version on server 2024-04-17T14:18:12.230 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-04-17T14:18:12.230 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:18:12.317 DEBUG:teuthology.orchestra.run.smithi117:> true 2024-04-17T14:18:12.488 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-04-17T14:18:12.488 DEBUG:teuthology.orchestra.run.smithi117:> uname -m 2024-04-17T14:18:12.543 INFO:teuthology.orchestra.run.smithi117.stdout:x86_64 2024-04-17T14:18:12.543 DEBUG:teuthology.orchestra.run.smithi117:> cat /etc/os-release 2024-04-17T14:18:12.598 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="CentOS Stream" 2024-04-17T14:18:12.598 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="9" 2024-04-17T14:18:12.598 INFO:teuthology.orchestra.run.smithi117.stdout:ID="centos" 2024-04-17T14:18:12.598 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE="rhel fedora" 2024-04-17T14:18:12.598 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="9" 2024-04-17T14:18:12.598 INFO:teuthology.orchestra.run.smithi117.stdout:PLATFORM_ID="platform:el9" 2024-04-17T14:18:12.598 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T14:18:12.598 INFO:teuthology.orchestra.run.smithi117.stdout:ANSI_COLOR="0;31" 2024-04-17T14:18:12.598 INFO:teuthology.orchestra.run.smithi117.stdout:LOGO="fedora-logo-icon" 2024-04-17T14:18:12.598 INFO:teuthology.orchestra.run.smithi117.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T14:18:12.598 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://centos.org/" 2024-04-17T14:18:12.599 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T14:18:12.599 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T14:18:12.599 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T14:18:12.599 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server 2024-04-17T14:18:12.621 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T14:18:12.708 INFO:teuthology.dispatcher.supervisor:Running job 7660279 2024-04-17T14:18:12.708 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2024-04-17_11:26:41-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660279 --name rishabh-2024-04-17_11:26:41-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/kernel_untar_build}} -- /home/teuthworker/archive/rishabh-2024-04-17_11:26:41-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660279/orig.config.yaml 2024-04-17T14:18:12.711 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2024-04-17_11:26:41-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660279 2024-04-17T14:18:12.711 INFO:teuthology.dispatcher.supervisor:Job PID: 1341995 2024-04-17T14:18:12.711 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-17T14:20:12.797 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T14:22:12.971 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T14:24:13.152 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T14:26:13.327 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T14:28:13.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T14:30:13.667 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T14:32:13.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T14:34:14.023 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T14:34:14.104 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1