2024-04-18T08:23:25.794 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-18T08:23:25.794 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T08:23:26.017 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7efd3ad06c10>, signals=[15]) 2024-04-18T08:23:26.017 INFO:teuthology.lock.ops:Start node 'smithi130.front.sepia.ceph.com' reimaging 2024-04-18T08:23:26.018 INFO:teuthology.lock.ops:Updating [smithi130.front.sepia.ceph.com]: reset os type and version on server 2024-04-18T08:23:26.018 INFO:teuthology.lock.ops:Updating smithi130.front.sepia.ceph.com on lock server 2024-04-18T08:23:26.046 INFO:teuthology.lock.ops:Start node 'smithi177.front.sepia.ceph.com' reimaging 2024-04-18T08:23:26.046 INFO:teuthology.lock.ops:Updating [smithi177.front.sepia.ceph.com]: reset os type and version on server 2024-04-18T08:23:26.046 INFO:teuthology.lock.ops:Updating smithi177.front.sepia.ceph.com on lock server 2024-04-18T08:23:26.070 INFO:teuthology.lock.ops:Start node 'smithi190.front.sepia.ceph.com' reimaging 2024-04-18T08:23:26.070 INFO:teuthology.lock.ops:Updating [smithi190.front.sepia.ceph.com]: reset os type and version on server 2024-04-18T08:23:26.070 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2024-04-18T08:23:26.156 DEBUG:teuthology.provision.fog.smithi130:Requesting image smithi_centos_9.stream (ID 10) 2024-04-18T08:23:26.185 DEBUG:teuthology.provision.fog.smithi177:Requesting image smithi_centos_9.stream (ID 10) 2024-04-18T08:23:26.207 DEBUG:teuthology.provision.fog.smithi190:Requesting image smithi_centos_9.stream (ID 10) 2024-04-18T08:23:26.211 INFO:teuthology.provision.fog.smithi130:Scheduling deploy of centos 9.stream 2024-04-18T08:23:26.234 INFO:teuthology.provision.fog.smithi177:Scheduling deploy of centos 9.stream 2024-04-18T08:23:26.254 INFO:teuthology.provision.fog.smithi190:Scheduling deploy of centos 9.stream 2024-04-18T08:23:26.445 INFO:teuthology.orchestra.console.smithi130:Power off 2024-04-18T08:23:26.445 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-18T08:23:26.468 DEBUG:teuthology.orchestra.console.smithi130:power off output: Chassis Power Control: Down/Off 2024-04-18T08:23:26.468 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T08:23:26.482 INFO:teuthology.orchestra.console.smithi177:Power off 2024-04-18T08:23:26.482 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-18T08:23:26.496 INFO:teuthology.orchestra.console.smithi190:Power off 2024-04-18T08:23:26.496 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-18T08:23:26.505 DEBUG:teuthology.orchestra.console.smithi177:power off output: Chassis Power Control: Down/Off 2024-04-18T08:23:26.505 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T08:23:26.511 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is on 2024-04-18T08:23:26.518 DEBUG:teuthology.orchestra.console.smithi190:power off output: Chassis Power Control: Down/Off 2024-04-18T08:23:26.519 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T08:23:26.527 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is on 2024-04-18T08:23:26.541 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2024-04-18T08:23:30.515 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T08:23:30.529 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T08:23:30.542 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T08:23:30.625 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is on 2024-04-18T08:23:30.639 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is on 2024-04-18T08:23:30.650 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2024-04-18T08:23:34.629 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T08:23:34.640 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T08:23:34.652 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T08:23:34.742 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is on 2024-04-18T08:23:34.752 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is off 2024-04-18T08:23:34.760 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2024-04-18T08:23:34.853 INFO:teuthology.orchestra.console.smithi177:Power off completed 2024-04-18T08:23:34.861 INFO:teuthology.orchestra.console.smithi190:Power off completed 2024-04-18T08:23:34.954 INFO:teuthology.orchestra.console.smithi177:Power on 2024-04-18T08:23:34.954 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-18T08:23:34.962 INFO:teuthology.orchestra.console.smithi190:Power on 2024-04-18T08:23:34.962 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-18T08:23:34.979 DEBUG:teuthology.orchestra.console.smithi177:power on output: Chassis Power Control: Up/On 2024-04-18T08:23:34.980 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T08:23:34.988 DEBUG:teuthology.orchestra.console.smithi190:power on output: Chassis Power Control: Up/On 2024-04-18T08:23:34.989 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T08:23:35.001 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is off 2024-04-18T08:23:35.010 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2024-04-18T08:23:38.746 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T08:23:38.856 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is off 2024-04-18T08:23:38.956 INFO:teuthology.orchestra.console.smithi130:Power off completed 2024-04-18T08:23:39.002 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T08:23:39.011 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T08:23:39.057 INFO:teuthology.orchestra.console.smithi130:Power on 2024-04-18T08:23:39.058 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-18T08:23:39.081 DEBUG:teuthology.orchestra.console.smithi130:power on output: Chassis Power Control: Up/On 2024-04-18T08:23:39.081 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T08:23:39.103 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is off 2024-04-18T08:23:39.113 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is off 2024-04-18T08:23:39.119 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2024-04-18T08:23:43.106 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T08:23:43.114 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T08:23:43.121 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T08:23:43.216 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is on 2024-04-18T08:23:43.223 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is on 2024-04-18T08:23:43.231 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2024-04-18T08:23:43.318 INFO:teuthology.orchestra.console.smithi130:Power on completed 2024-04-18T08:23:43.324 INFO:teuthology.orchestra.console.smithi177:Power on completed 2024-04-18T08:23:43.333 INFO:teuthology.orchestra.console.smithi190:Power on completed 2024-04-18T08:23:43.419 INFO:teuthology.provision.fog.smithi130:Waiting for deploy to finish 2024-04-18T08:23:43.425 INFO:teuthology.provision.fog.smithi177:Waiting for deploy to finish 2024-04-18T08:23:43.433 INFO:teuthology.provision.fog.smithi190:Waiting for deploy to finish 2024-04-18T08:26:14.362 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T08:26:14.373 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T08:26:14.376 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T08:26:14.680 ERROR:teuthology.orchestra.connection:Error authenticating with smithi130.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-04-18T08:26:32.862 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2024-04-18T08:26:32.863 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2024-04-18T08:26:38.864 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T08:26:38.866 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T08:26:41.922 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2024-04-18T08:26:41.923 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2024-04-18T08:26:47.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T08:26:47.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T08:26:50.974 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2024-04-18T08:26:51.006 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2024-04-18T08:26:56.975 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T08:26:57.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T08:27:00.030 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2024-04-18T08:27:00.066 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2024-04-18T08:27:06.032 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T08:27:06.068 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T08:27:09.087 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2024-04-18T08:27:15.088 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T08:27:18.682 WARNING:teuthology.provision.fog.smithi130:timed out 2024-04-18T08:27:24.684 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T08:27:43.011 WARNING:teuthology.provision.fog.smithi130:[Errno None] Unable to connect to port 22 on 172.21.15.130 2024-04-18T08:27:49.012 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T08:27:52.062 WARNING:teuthology.provision.fog.smithi130:[Errno None] Unable to connect to port 22 on 172.21.15.130 2024-04-18T08:27:58.064 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T08:27:58.410 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-18T08:27:58.411 DEBUG:teuthology.orchestra.run.smithi130:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-18T08:28:06.070 WARNING:teuthology.provision.fog.smithi190:timed out 2024-04-18T08:28:12.073 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T08:28:12.368 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-18T08:28:12.368 DEBUG:teuthology.orchestra.run.smithi190:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-18T08:28:12.717 INFO:teuthology.provision.fog.smithi190:Node is ready 2024-04-18T08:28:12.717 DEBUG:teuthology.orchestra.run.smithi190:> hostname 2024-04-18T08:28:12.732 INFO:teuthology.orchestra.run.smithi190.stdout:smithi190.front.sepia.ceph.com 2024-04-18T08:28:12.732 DEBUG:teuthology.orchestra.run.smithi190:> grep smithi190.front.sepia.ceph.com /etc/hosts 2024-04-18T08:28:12.787 INFO:teuthology.orchestra.run.smithi190.stdout:172.21.15.190 smithi190.front.sepia.ceph.com smithi190 2024-04-18T08:28:12.787 DEBUG:teuthology.orchestra.run.smithi190:> sudo hostname smithi190 2024-04-18T08:28:12.885 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/smithi190.front.sepia.ceph.com/smithi190/g' /etc/hosts 2024-04-18T08:28:12.912 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/172.21.15.190/172.21.15.190/g' /etc/hosts 2024-04-18T08:28:12.979 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/smithi190.front.sepia.ceph.com/smithi190/g' /etc/hostname 2024-04-18T08:28:13.046 DEBUG:teuthology.orchestra.run.smithi190:> sudo hostname smithi190 2024-04-18T08:28:13.112 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release 2024-04-18T08:28:13.166 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="CentOS Stream" 2024-04-18T08:28:13.167 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="9" 2024-04-18T08:28:13.167 INFO:teuthology.orchestra.run.smithi190.stdout:ID="centos" 2024-04-18T08:28:13.167 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE="rhel fedora" 2024-04-18T08:28:13.167 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="9" 2024-04-18T08:28:13.167 INFO:teuthology.orchestra.run.smithi190.stdout:PLATFORM_ID="platform:el9" 2024-04-18T08:28:13.167 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-18T08:28:13.167 INFO:teuthology.orchestra.run.smithi190.stdout:ANSI_COLOR="0;31" 2024-04-18T08:28:13.167 INFO:teuthology.orchestra.run.smithi190.stdout:LOGO="fedora-logo-icon" 2024-04-18T08:28:13.167 INFO:teuthology.orchestra.run.smithi190.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-18T08:28:13.167 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://centos.org/" 2024-04-18T08:28:13.167 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T08:28:13.167 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-18T08:28:13.167 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-18T08:28:13.168 INFO:teuthology.provision.fog.smithi190:Deploy complete! 2024-04-18T08:28:13.170 DEBUG:teuthology.parallel:result is None 2024-04-18T08:28:13.743 INFO:teuthology.provision.fog.smithi130:Node is ready 2024-04-18T08:28:13.800 DEBUG:teuthology.orchestra.run.smithi130:> hostname 2024-04-18T08:28:13.817 INFO:teuthology.orchestra.run.smithi130.stdout:smithi046 2024-04-18T08:28:13.818 DEBUG:teuthology.orchestra.run.smithi130:> grep smithi046 /etc/hosts 2024-04-18T08:28:13.876 INFO:teuthology.orchestra.run.smithi130.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2024-04-18T08:28:13.876 DEBUG:teuthology.orchestra.run.smithi130:> sudo hostname smithi130 2024-04-18T08:28:14.012 DEBUG:teuthology.orchestra.run.smithi130:> sudo sed -i -e 's/smithi046/smithi130/g' /etc/hosts 2024-04-18T08:28:14.043 DEBUG:teuthology.orchestra.run.smithi130:> sudo sed -i -e 's/172.21.15.46/172.21.15.130/g' /etc/hosts 2024-04-18T08:28:14.112 DEBUG:teuthology.orchestra.run.smithi130:> sudo sed -i -e 's/smithi046/smithi130/g' /etc/hostname 2024-04-18T08:28:14.182 DEBUG:teuthology.orchestra.run.smithi130:> sudo hostname smithi130 2024-04-18T08:28:14.250 DEBUG:teuthology.orchestra.run.smithi130:> cat /etc/os-release 2024-04-18T08:28:14.305 INFO:teuthology.orchestra.run.smithi130.stdout:NAME="CentOS Stream" 2024-04-18T08:28:14.305 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION="9" 2024-04-18T08:28:14.305 INFO:teuthology.orchestra.run.smithi130.stdout:ID="centos" 2024-04-18T08:28:14.306 INFO:teuthology.orchestra.run.smithi130.stdout:ID_LIKE="rhel fedora" 2024-04-18T08:28:14.306 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION_ID="9" 2024-04-18T08:28:14.306 INFO:teuthology.orchestra.run.smithi130.stdout:PLATFORM_ID="platform:el9" 2024-04-18T08:28:14.306 INFO:teuthology.orchestra.run.smithi130.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-18T08:28:14.306 INFO:teuthology.orchestra.run.smithi130.stdout:ANSI_COLOR="0;31" 2024-04-18T08:28:14.306 INFO:teuthology.orchestra.run.smithi130.stdout:LOGO="fedora-logo-icon" 2024-04-18T08:28:14.306 INFO:teuthology.orchestra.run.smithi130.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-18T08:28:14.306 INFO:teuthology.orchestra.run.smithi130.stdout:HOME_URL="https://centos.org/" 2024-04-18T08:28:14.306 INFO:teuthology.orchestra.run.smithi130.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T08:28:14.306 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-18T08:28:14.306 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-18T08:28:14.307 INFO:teuthology.provision.fog.smithi130:Deploy complete! 2024-04-18T08:28:14.307 DEBUG:teuthology.parallel:result is None 2024-04-18T08:28:15.090 WARNING:teuthology.provision.fog.smithi177:timed out 2024-04-18T08:28:21.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T08:28:21.291 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-18T08:28:21.291 DEBUG:teuthology.orchestra.run.smithi177:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-18T08:28:21.604 INFO:teuthology.provision.fog.smithi177:Node is ready 2024-04-18T08:28:21.605 DEBUG:teuthology.orchestra.run.smithi177:> hostname 2024-04-18T08:28:21.619 INFO:teuthology.orchestra.run.smithi177.stdout:smithi177.front.sepia.ceph.com 2024-04-18T08:28:21.620 DEBUG:teuthology.orchestra.run.smithi177:> grep smithi177.front.sepia.ceph.com /etc/hosts 2024-04-18T08:28:21.676 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.15.177 smithi177.front.sepia.ceph.com smithi177 2024-04-18T08:28:21.676 DEBUG:teuthology.orchestra.run.smithi177:> sudo hostname smithi177 2024-04-18T08:28:21.782 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/smithi177.front.sepia.ceph.com/smithi177/g' /etc/hosts 2024-04-18T08:28:21.810 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/172.21.15.177/172.21.15.177/g' /etc/hosts 2024-04-18T08:28:21.878 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/smithi177.front.sepia.ceph.com/smithi177/g' /etc/hostname 2024-04-18T08:28:21.945 DEBUG:teuthology.orchestra.run.smithi177:> sudo hostname smithi177 2024-04-18T08:28:22.011 DEBUG:teuthology.orchestra.run.smithi177:> cat /etc/os-release 2024-04-18T08:28:22.065 INFO:teuthology.orchestra.run.smithi177.stdout:NAME="CentOS Stream" 2024-04-18T08:28:22.066 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION="9" 2024-04-18T08:28:22.066 INFO:teuthology.orchestra.run.smithi177.stdout:ID="centos" 2024-04-18T08:28:22.066 INFO:teuthology.orchestra.run.smithi177.stdout:ID_LIKE="rhel fedora" 2024-04-18T08:28:22.066 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_ID="9" 2024-04-18T08:28:22.066 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM_ID="platform:el9" 2024-04-18T08:28:22.066 INFO:teuthology.orchestra.run.smithi177.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-18T08:28:22.066 INFO:teuthology.orchestra.run.smithi177.stdout:ANSI_COLOR="0;31" 2024-04-18T08:28:22.066 INFO:teuthology.orchestra.run.smithi177.stdout:LOGO="fedora-logo-icon" 2024-04-18T08:28:22.066 INFO:teuthology.orchestra.run.smithi177.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-18T08:28:22.066 INFO:teuthology.orchestra.run.smithi177.stdout:HOME_URL="https://centos.org/" 2024-04-18T08:28:22.066 INFO:teuthology.orchestra.run.smithi177.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T08:28:22.067 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-18T08:28:22.067 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-18T08:28:22.067 INFO:teuthology.provision.fog.smithi177:Deploy complete! 2024-04-18T08:28:22.067 DEBUG:teuthology.parallel:result is None 2024-04-18T08:28:22.284 INFO:teuthology.lock.ops:Checking smithi130.front.sepia.ceph.com 2024-04-18T08:28:22.284 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-18T08:28:22.310 INFO:teuthology.lock.ops:Checking smithi177.front.sepia.ceph.com 2024-04-18T08:28:22.311 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-18T08:28:22.335 INFO:teuthology.lock.ops:Checking smithi190.front.sepia.ceph.com 2024-04-18T08:28:22.335 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-18T08:28:22.353 INFO:teuthology.lock.ops:Updating [smithi130.front.sepia.ceph.com]: set os type and version on server 2024-04-18T08:28:22.353 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-04-18T08:28:22.354 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T08:28:22.444 DEBUG:teuthology.orchestra.run.smithi130:> true 2024-04-18T08:28:22.515 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-04-18T08:28:22.515 DEBUG:teuthology.orchestra.run.smithi130:> uname -m 2024-04-18T08:28:22.571 INFO:teuthology.orchestra.run.smithi130.stdout:x86_64 2024-04-18T08:28:22.572 DEBUG:teuthology.orchestra.run.smithi130:> cat /etc/os-release 2024-04-18T08:28:22.628 INFO:teuthology.orchestra.run.smithi130.stdout:NAME="CentOS Stream" 2024-04-18T08:28:22.628 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION="9" 2024-04-18T08:28:22.628 INFO:teuthology.orchestra.run.smithi130.stdout:ID="centos" 2024-04-18T08:28:22.628 INFO:teuthology.orchestra.run.smithi130.stdout:ID_LIKE="rhel fedora" 2024-04-18T08:28:22.628 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION_ID="9" 2024-04-18T08:28:22.628 INFO:teuthology.orchestra.run.smithi130.stdout:PLATFORM_ID="platform:el9" 2024-04-18T08:28:22.629 INFO:teuthology.orchestra.run.smithi130.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-18T08:28:22.629 INFO:teuthology.orchestra.run.smithi130.stdout:ANSI_COLOR="0;31" 2024-04-18T08:28:22.629 INFO:teuthology.orchestra.run.smithi130.stdout:LOGO="fedora-logo-icon" 2024-04-18T08:28:22.629 INFO:teuthology.orchestra.run.smithi130.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-18T08:28:22.629 INFO:teuthology.orchestra.run.smithi130.stdout:HOME_URL="https://centos.org/" 2024-04-18T08:28:22.629 INFO:teuthology.orchestra.run.smithi130.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T08:28:22.629 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-18T08:28:22.629 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-18T08:28:22.630 INFO:teuthology.lock.ops:Updating smithi130.front.sepia.ceph.com on lock server 2024-04-18T08:28:22.652 INFO:teuthology.lock.ops:Updating [smithi177.front.sepia.ceph.com]: set os type and version on server 2024-04-18T08:28:22.652 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-04-18T08:28:22.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T08:28:22.736 DEBUG:teuthology.orchestra.run.smithi177:> true 2024-04-18T08:28:22.804 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-04-18T08:28:22.805 DEBUG:teuthology.orchestra.run.smithi177:> uname -m 2024-04-18T08:28:22.860 INFO:teuthology.orchestra.run.smithi177.stdout:x86_64 2024-04-18T08:28:22.860 DEBUG:teuthology.orchestra.run.smithi177:> cat /etc/os-release 2024-04-18T08:28:22.915 INFO:teuthology.orchestra.run.smithi177.stdout:NAME="CentOS Stream" 2024-04-18T08:28:22.915 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION="9" 2024-04-18T08:28:22.915 INFO:teuthology.orchestra.run.smithi177.stdout:ID="centos" 2024-04-18T08:28:22.915 INFO:teuthology.orchestra.run.smithi177.stdout:ID_LIKE="rhel fedora" 2024-04-18T08:28:22.915 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_ID="9" 2024-04-18T08:28:22.915 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM_ID="platform:el9" 2024-04-18T08:28:22.915 INFO:teuthology.orchestra.run.smithi177.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-18T08:28:22.915 INFO:teuthology.orchestra.run.smithi177.stdout:ANSI_COLOR="0;31" 2024-04-18T08:28:22.915 INFO:teuthology.orchestra.run.smithi177.stdout:LOGO="fedora-logo-icon" 2024-04-18T08:28:22.915 INFO:teuthology.orchestra.run.smithi177.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-18T08:28:22.915 INFO:teuthology.orchestra.run.smithi177.stdout:HOME_URL="https://centos.org/" 2024-04-18T08:28:22.916 INFO:teuthology.orchestra.run.smithi177.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T08:28:22.916 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-18T08:28:22.916 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-18T08:28:22.916 INFO:teuthology.lock.ops:Updating smithi177.front.sepia.ceph.com on lock server 2024-04-18T08:28:22.935 INFO:teuthology.lock.ops:Updating [smithi190.front.sepia.ceph.com]: set os type and version on server 2024-04-18T08:28:22.935 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2024-04-18T08:28:22.936 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T08:28:23.022 DEBUG:teuthology.orchestra.run.smithi190:> true 2024-04-18T08:28:23.091 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi190.front.sepia.ceph.com' 2024-04-18T08:28:23.091 DEBUG:teuthology.orchestra.run.smithi190:> uname -m 2024-04-18T08:28:23.147 INFO:teuthology.orchestra.run.smithi190.stdout:x86_64 2024-04-18T08:28:23.147 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release 2024-04-18T08:28:23.202 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="CentOS Stream" 2024-04-18T08:28:23.202 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="9" 2024-04-18T08:28:23.202 INFO:teuthology.orchestra.run.smithi190.stdout:ID="centos" 2024-04-18T08:28:23.202 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE="rhel fedora" 2024-04-18T08:28:23.203 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="9" 2024-04-18T08:28:23.203 INFO:teuthology.orchestra.run.smithi190.stdout:PLATFORM_ID="platform:el9" 2024-04-18T08:28:23.203 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-18T08:28:23.203 INFO:teuthology.orchestra.run.smithi190.stdout:ANSI_COLOR="0;31" 2024-04-18T08:28:23.203 INFO:teuthology.orchestra.run.smithi190.stdout:LOGO="fedora-logo-icon" 2024-04-18T08:28:23.203 INFO:teuthology.orchestra.run.smithi190.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-18T08:28:23.203 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://centos.org/" 2024-04-18T08:28:23.203 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T08:28:23.203 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-18T08:28:23.203 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-18T08:28:23.204 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2024-04-18T08:28:23.227 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T08:28:23.333 INFO:teuthology.dispatcher.supervisor:Running job 7660780 2024-04-18T08:28:23.333 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-04-17_20:24:14-fs-main-distro-default-smithi/7660780 --name teuthology-2024-04-17_20:24:14-fs-main-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/kernel_untar_build}} -- /home/teuthworker/archive/teuthology-2024-04-17_20:24:14-fs-main-distro-default-smithi/7660780/orig.config.yaml 2024-04-18T08:28:23.336 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-04-17_20:24:14-fs-main-distro-default-smithi/7660780 2024-04-18T08:28:23.337 INFO:teuthology.dispatcher.supervisor:Job PID: 2713655 2024-04-18T08:28:23.337 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-18T08:30:23.339 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T08:32:23.417 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T08:34:23.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T08:36:23.565 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T08:36:23.644 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1