2024-04-14T09:43:03.814 INFO:root:teuthology version: 0.0.1.dev265+gd7d6e60 2024-04-14T09:43:03.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-14T09:43:04.002 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f281ca90c10>, signals=[15]) 2024-04-14T09:43:04.002 INFO:teuthology.lock.ops:Start node 'smithi029.front.sepia.ceph.com' reimaging 2024-04-14T09:43:04.002 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: reset os type and version on server 2024-04-14T09:43:04.003 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server 2024-04-14T09:43:04.019 INFO:teuthology.lock.ops:Start node 'smithi066.front.sepia.ceph.com' reimaging 2024-04-14T09:43:04.019 INFO:teuthology.lock.ops:Updating [smithi066.front.sepia.ceph.com]: reset os type and version on server 2024-04-14T09:43:04.020 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server 2024-04-14T09:43:04.044 INFO:teuthology.lock.ops:Start node 'smithi153.front.sepia.ceph.com' reimaging 2024-04-14T09:43:04.044 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: reset os type and version on server 2024-04-14T09:43:04.044 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2024-04-14T09:43:04.133 DEBUG:teuthology.provision.fog.smithi029:Requesting image smithi_centos_9.stream (ID 10) 2024-04-14T09:43:04.147 DEBUG:teuthology.provision.fog.smithi066:Requesting image smithi_centos_9.stream (ID 10) 2024-04-14T09:43:04.163 DEBUG:teuthology.provision.fog.smithi153:Requesting image smithi_centos_9.stream (ID 10) 2024-04-14T09:43:04.175 INFO:teuthology.provision.fog.smithi029:Scheduling deploy of centos 9.stream 2024-04-14T09:43:04.188 INFO:teuthology.provision.fog.smithi066:Scheduling deploy of centos 9.stream 2024-04-14T09:43:04.209 INFO:teuthology.provision.fog.smithi153:Scheduling deploy of centos 9.stream 2024-04-14T09:43:04.474 INFO:teuthology.orchestra.console.smithi029:Power off 2024-04-14T09:43:04.475 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-14T09:43:04.491 INFO:teuthology.orchestra.console.smithi066:Power off 2024-04-14T09:43:04.491 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-14T09:43:04.503 DEBUG:teuthology.orchestra.console.smithi029:power off output: Chassis Power Control: Down/Off 2024-04-14T09:43:04.503 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-14T09:43:04.515 DEBUG:teuthology.orchestra.console.smithi066:power off output: Chassis Power Control: Down/Off 2024-04-14T09:43:04.516 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-14T09:43:04.528 INFO:teuthology.orchestra.console.smithi153:Power off 2024-04-14T09:43:04.528 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-14T09:43:04.537 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off 2024-04-14T09:43:04.538 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is on 2024-04-14T09:43:04.550 DEBUG:teuthology.orchestra.console.smithi153:power off output: Chassis Power Control: Down/Off 2024-04-14T09:43:04.550 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-14T09:43:04.572 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2024-04-14T09:43:04.638 INFO:teuthology.orchestra.console.smithi029:Power off completed 2024-04-14T09:43:04.739 INFO:teuthology.orchestra.console.smithi029:Power on 2024-04-14T09:43:04.739 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-14T09:43:04.760 DEBUG:teuthology.orchestra.console.smithi029:power on output: Chassis Power Control: Up/On 2024-04-14T09:43:04.760 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-14T09:43:04.787 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off 2024-04-14T09:43:08.542 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-14T09:43:08.574 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-14T09:43:08.652 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is on 2024-04-14T09:43:08.683 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2024-04-14T09:43:08.789 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-14T09:43:08.898 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off 2024-04-14T09:43:12.656 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-14T09:43:12.684 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-14T09:43:12.765 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is off 2024-04-14T09:43:12.793 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off 2024-04-14T09:43:12.866 INFO:teuthology.orchestra.console.smithi066:Power off completed 2024-04-14T09:43:12.894 INFO:teuthology.orchestra.console.smithi153:Power off completed 2024-04-14T09:43:12.899 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-14T09:43:12.967 INFO:teuthology.orchestra.console.smithi066:Power on 2024-04-14T09:43:12.967 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-14T09:43:12.988 DEBUG:teuthology.orchestra.console.smithi066:power on output: Chassis Power Control: Up/On 2024-04-14T09:43:12.989 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-14T09:43:12.996 INFO:teuthology.orchestra.console.smithi153:Power on 2024-04-14T09:43:12.996 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-14T09:43:13.008 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is on 2024-04-14T09:43:13.013 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is off 2024-04-14T09:43:13.019 DEBUG:teuthology.orchestra.console.smithi153:power on output: Chassis Power Control: Up/On 2024-04-14T09:43:13.019 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-14T09:43:13.040 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off 2024-04-14T09:43:13.109 INFO:teuthology.orchestra.console.smithi029:Power on completed 2024-04-14T09:43:13.209 INFO:teuthology.provision.fog.smithi029:Waiting for deploy to finish 2024-04-14T09:43:17.018 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-14T09:43:17.042 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-14T09:43:17.127 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is off 2024-04-14T09:43:17.153 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off 2024-04-14T09:43:21.130 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-14T09:43:21.154 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-14T09:43:21.263 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2024-04-14T09:43:21.282 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is on 2024-04-14T09:43:21.364 INFO:teuthology.orchestra.console.smithi153:Power on completed 2024-04-14T09:43:21.383 INFO:teuthology.orchestra.console.smithi066:Power on completed 2024-04-14T09:43:21.465 INFO:teuthology.provision.fog.smithi153:Waiting for deploy to finish 2024-04-14T09:43:21.484 INFO:teuthology.provision.fog.smithi066:Waiting for deploy to finish 2024-04-14T09:45:52.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:46:22.368 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:46:25.438 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-04-14T09:46:29.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:46:31.439 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:46:32.254 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29 2024-04-14T09:46:34.494 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-04-14T09:46:38.256 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:46:40.496 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:46:41.310 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29 2024-04-14T09:46:43.554 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-04-14T09:46:47.312 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:46:49.558 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:46:50.366 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29 2024-04-14T09:46:52.639 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-04-14T09:46:56.367 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:46:58.641 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:46:59.423 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29 2024-04-14T09:47:01.698 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-04-14T09:47:05.425 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:47:07.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:47:08.478 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29 2024-04-14T09:47:10.750 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-04-14T09:47:14.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:47:16.752 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:47:17.534 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29 2024-04-14T09:47:19.810 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-04-14T09:47:23.067 ERROR:teuthology.orchestra.connection:Error authenticating with smithi153.front.sepia.ceph.com: AuthenticationException('Authentication timeout.') 2024-04-14T09:47:23.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:47:25.812 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:47:28.862 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-04-14T09:47:30.142 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2024-04-14T09:47:34.864 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:47:36.144 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:47:39.509 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-14T09:47:39.509 DEBUG:teuthology.orchestra.run.smithi153:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-14T09:47:43.262 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2024-04-14T09:48:04.821 INFO:teuthology.provision.fog.smithi153:Node is ready 2024-04-14T09:48:04.822 DEBUG:teuthology.orchestra.run.smithi153:> hostname 2024-04-14T09:48:04.841 INFO:teuthology.orchestra.run.smithi153.stdout:smithi153.front.sepia.ceph.com 2024-04-14T09:48:04.841 DEBUG:teuthology.orchestra.run.smithi153:> grep smithi153.front.sepia.ceph.com /etc/hosts 2024-04-14T09:48:04.899 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.15.153 smithi153.front.sepia.ceph.com smithi153 2024-04-14T09:48:04.899 DEBUG:teuthology.orchestra.run.smithi153:> sudo hostname smithi153 2024-04-14T09:48:05.030 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/smithi153.front.sepia.ceph.com/smithi153/g' /etc/hosts 2024-04-14T09:48:05.063 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/172.21.15.153/172.21.15.153/g' /etc/hosts 2024-04-14T09:48:05.134 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/smithi153.front.sepia.ceph.com/smithi153/g' /etc/hostname 2024-04-14T09:48:05.203 DEBUG:teuthology.orchestra.run.smithi153:> sudo hostname smithi153 2024-04-14T09:48:05.271 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release 2024-04-14T09:48:05.327 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="CentOS Stream" 2024-04-14T09:48:05.327 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="9" 2024-04-14T09:48:05.327 INFO:teuthology.orchestra.run.smithi153.stdout:ID="centos" 2024-04-14T09:48:05.327 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE="rhel fedora" 2024-04-14T09:48:05.327 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="9" 2024-04-14T09:48:05.327 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM_ID="platform:el9" 2024-04-14T09:48:05.327 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-14T09:48:05.327 INFO:teuthology.orchestra.run.smithi153.stdout:ANSI_COLOR="0;31" 2024-04-14T09:48:05.327 INFO:teuthology.orchestra.run.smithi153.stdout:LOGO="fedora-logo-icon" 2024-04-14T09:48:05.327 INFO:teuthology.orchestra.run.smithi153.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-14T09:48:05.328 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://centos.org/" 2024-04-14T09:48:05.328 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-14T09:48:05.328 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-14T09:48:05.328 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-14T09:48:05.328 INFO:teuthology.provision.fog.smithi153:Deploy complete! 2024-04-14T09:48:05.330 DEBUG:teuthology.parallel:result is None 2024-04-14T09:48:23.558 WARNING:teuthology.provision.fog.smithi029:timed out 2024-04-14T09:48:29.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:48:29.877 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-14T09:48:29.877 DEBUG:teuthology.orchestra.run.smithi029:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-14T09:48:30.216 INFO:teuthology.provision.fog.smithi029:Node is ready 2024-04-14T09:48:30.216 DEBUG:teuthology.orchestra.run.smithi029:> hostname 2024-04-14T09:48:30.231 INFO:teuthology.orchestra.run.smithi029.stdout:smithi029.front.sepia.ceph.com 2024-04-14T09:48:30.232 DEBUG:teuthology.orchestra.run.smithi029:> grep smithi029.front.sepia.ceph.com /etc/hosts 2024-04-14T09:48:30.288 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29 smithi029.front.sepia.ceph.com smithi029 2024-04-14T09:48:30.288 DEBUG:teuthology.orchestra.run.smithi029:> sudo hostname smithi029 2024-04-14T09:48:30.420 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/smithi029.front.sepia.ceph.com/smithi029/g' /etc/hosts 2024-04-14T09:48:30.452 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/172.21.15.29/172.21.15.29/g' /etc/hosts 2024-04-14T09:48:30.523 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/smithi029.front.sepia.ceph.com/smithi029/g' /etc/hostname 2024-04-14T09:48:30.595 DEBUG:teuthology.orchestra.run.smithi029:> sudo hostname smithi029 2024-04-14T09:48:30.666 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release 2024-04-14T09:48:30.721 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="CentOS Stream" 2024-04-14T09:48:30.721 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="9" 2024-04-14T09:48:30.721 INFO:teuthology.orchestra.run.smithi029.stdout:ID="centos" 2024-04-14T09:48:30.721 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="rhel fedora" 2024-04-14T09:48:30.721 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="9" 2024-04-14T09:48:30.721 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el9" 2024-04-14T09:48:30.721 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-14T09:48:30.721 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31" 2024-04-14T09:48:30.721 INFO:teuthology.orchestra.run.smithi029.stdout:LOGO="fedora-logo-icon" 2024-04-14T09:48:30.722 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-14T09:48:30.722 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://centos.org/" 2024-04-14T09:48:30.722 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-14T09:48:30.722 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-14T09:48:30.722 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-14T09:48:30.722 INFO:teuthology.provision.fog.smithi029:Deploy complete! 2024-04-14T09:48:30.723 DEBUG:teuthology.parallel:result is None 2024-04-14T09:48:34.870 WARNING:teuthology.provision.fog.smithi066:timed out 2024-04-14T09:48:40.875 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:48:41.131 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-14T09:48:41.131 DEBUG:teuthology.orchestra.run.smithi066:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-14T09:48:41.463 INFO:teuthology.provision.fog.smithi066:Node is ready 2024-04-14T09:48:41.463 DEBUG:teuthology.orchestra.run.smithi066:> hostname 2024-04-14T09:48:41.478 INFO:teuthology.orchestra.run.smithi066.stdout:smithi066.front.sepia.ceph.com 2024-04-14T09:48:41.478 DEBUG:teuthology.orchestra.run.smithi066:> grep smithi066.front.sepia.ceph.com /etc/hosts 2024-04-14T09:48:41.534 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66 smithi066.front.sepia.ceph.com smithi066 2024-04-14T09:48:41.534 DEBUG:teuthology.orchestra.run.smithi066:> sudo hostname smithi066 2024-04-14T09:48:41.654 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i -e 's/smithi066.front.sepia.ceph.com/smithi066/g' /etc/hosts 2024-04-14T09:48:41.686 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i -e 's/172.21.15.66/172.21.15.66/g' /etc/hosts 2024-04-14T09:48:41.757 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i -e 's/smithi066.front.sepia.ceph.com/smithi066/g' /etc/hostname 2024-04-14T09:48:41.828 DEBUG:teuthology.orchestra.run.smithi066:> sudo hostname smithi066 2024-04-14T09:48:41.898 DEBUG:teuthology.orchestra.run.smithi066:> cat /etc/os-release 2024-04-14T09:48:41.954 INFO:teuthology.orchestra.run.smithi066.stdout:NAME="CentOS Stream" 2024-04-14T09:48:41.954 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION="9" 2024-04-14T09:48:41.955 INFO:teuthology.orchestra.run.smithi066.stdout:ID="centos" 2024-04-14T09:48:41.955 INFO:teuthology.orchestra.run.smithi066.stdout:ID_LIKE="rhel fedora" 2024-04-14T09:48:41.955 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_ID="9" 2024-04-14T09:48:41.955 INFO:teuthology.orchestra.run.smithi066.stdout:PLATFORM_ID="platform:el9" 2024-04-14T09:48:41.955 INFO:teuthology.orchestra.run.smithi066.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-14T09:48:41.955 INFO:teuthology.orchestra.run.smithi066.stdout:ANSI_COLOR="0;31" 2024-04-14T09:48:41.955 INFO:teuthology.orchestra.run.smithi066.stdout:LOGO="fedora-logo-icon" 2024-04-14T09:48:41.955 INFO:teuthology.orchestra.run.smithi066.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-14T09:48:41.955 INFO:teuthology.orchestra.run.smithi066.stdout:HOME_URL="https://centos.org/" 2024-04-14T09:48:41.955 INFO:teuthology.orchestra.run.smithi066.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-14T09:48:41.955 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-14T09:48:41.955 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-14T09:48:41.956 INFO:teuthology.provision.fog.smithi066:Deploy complete! 2024-04-14T09:48:41.956 DEBUG:teuthology.parallel:result is None 2024-04-14T09:48:42.221 INFO:teuthology.lock.ops:Checking smithi029.front.sepia.ceph.com 2024-04-14T09:48:42.222 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-14T09:48:42.245 INFO:teuthology.lock.ops:Checking smithi066.front.sepia.ceph.com 2024-04-14T09:48:42.245 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-14T09:48:42.261 INFO:teuthology.lock.ops:Checking smithi153.front.sepia.ceph.com 2024-04-14T09:48:42.261 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-14T09:48:42.279 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: set os type and version on server 2024-04-14T09:48:42.279 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-04-14T09:48:42.280 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:48:42.384 DEBUG:teuthology.orchestra.run.smithi029:> true 2024-04-14T09:48:42.569 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-04-14T09:48:42.569 DEBUG:teuthology.orchestra.run.smithi029:> uname -m 2024-04-14T09:48:42.625 INFO:teuthology.orchestra.run.smithi029.stdout:x86_64 2024-04-14T09:48:42.625 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release 2024-04-14T09:48:42.680 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="CentOS Stream" 2024-04-14T09:48:42.680 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="9" 2024-04-14T09:48:42.680 INFO:teuthology.orchestra.run.smithi029.stdout:ID="centos" 2024-04-14T09:48:42.680 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="rhel fedora" 2024-04-14T09:48:42.680 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="9" 2024-04-14T09:48:42.680 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el9" 2024-04-14T09:48:42.680 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-14T09:48:42.680 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31" 2024-04-14T09:48:42.681 INFO:teuthology.orchestra.run.smithi029.stdout:LOGO="fedora-logo-icon" 2024-04-14T09:48:42.681 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-14T09:48:42.681 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://centos.org/" 2024-04-14T09:48:42.681 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-14T09:48:42.681 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-14T09:48:42.681 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-14T09:48:42.681 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server 2024-04-14T09:48:42.703 INFO:teuthology.lock.ops:Updating [smithi066.front.sepia.ceph.com]: set os type and version on server 2024-04-14T09:48:42.703 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-04-14T09:48:42.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:48:42.804 DEBUG:teuthology.orchestra.run.smithi066:> true 2024-04-14T09:48:42.869 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-04-14T09:48:42.870 DEBUG:teuthology.orchestra.run.smithi066:> uname -m 2024-04-14T09:48:42.924 INFO:teuthology.orchestra.run.smithi066.stdout:x86_64 2024-04-14T09:48:42.924 DEBUG:teuthology.orchestra.run.smithi066:> cat /etc/os-release 2024-04-14T09:48:42.979 INFO:teuthology.orchestra.run.smithi066.stdout:NAME="CentOS Stream" 2024-04-14T09:48:42.979 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION="9" 2024-04-14T09:48:42.979 INFO:teuthology.orchestra.run.smithi066.stdout:ID="centos" 2024-04-14T09:48:42.979 INFO:teuthology.orchestra.run.smithi066.stdout:ID_LIKE="rhel fedora" 2024-04-14T09:48:42.980 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_ID="9" 2024-04-14T09:48:42.980 INFO:teuthology.orchestra.run.smithi066.stdout:PLATFORM_ID="platform:el9" 2024-04-14T09:48:42.980 INFO:teuthology.orchestra.run.smithi066.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-14T09:48:42.980 INFO:teuthology.orchestra.run.smithi066.stdout:ANSI_COLOR="0;31" 2024-04-14T09:48:42.980 INFO:teuthology.orchestra.run.smithi066.stdout:LOGO="fedora-logo-icon" 2024-04-14T09:48:42.980 INFO:teuthology.orchestra.run.smithi066.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-14T09:48:42.980 INFO:teuthology.orchestra.run.smithi066.stdout:HOME_URL="https://centos.org/" 2024-04-14T09:48:42.980 INFO:teuthology.orchestra.run.smithi066.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-14T09:48:42.980 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-14T09:48:42.980 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-14T09:48:42.981 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server 2024-04-14T09:48:43.029 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: set os type and version on server 2024-04-14T09:48:43.029 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-04-14T09:48:43.030 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:48:43.117 DEBUG:teuthology.orchestra.run.smithi153:> true 2024-04-14T09:48:43.289 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-04-14T09:48:43.289 DEBUG:teuthology.orchestra.run.smithi153:> uname -m 2024-04-14T09:48:43.344 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64 2024-04-14T09:48:43.345 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release 2024-04-14T09:48:43.400 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="CentOS Stream" 2024-04-14T09:48:43.400 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="9" 2024-04-14T09:48:43.400 INFO:teuthology.orchestra.run.smithi153.stdout:ID="centos" 2024-04-14T09:48:43.401 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE="rhel fedora" 2024-04-14T09:48:43.401 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="9" 2024-04-14T09:48:43.401 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM_ID="platform:el9" 2024-04-14T09:48:43.401 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-14T09:48:43.401 INFO:teuthology.orchestra.run.smithi153.stdout:ANSI_COLOR="0;31" 2024-04-14T09:48:43.401 INFO:teuthology.orchestra.run.smithi153.stdout:LOGO="fedora-logo-icon" 2024-04-14T09:48:43.401 INFO:teuthology.orchestra.run.smithi153.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-14T09:48:43.401 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://centos.org/" 2024-04-14T09:48:43.402 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-14T09:48:43.402 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-14T09:48:43.402 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-14T09:48:43.402 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2024-04-14T09:48:43.429 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-14T09:48:43.564 INFO:teuthology.dispatcher.supervisor:Running job 7638510 2024-04-14T09:48:43.564 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_d7d6e60867cadf19fbfd7655a551ae7d58060757/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi/7638510 --name teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/kernel_untar_build}} -- /home/teuthworker/archive/teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi/7638510/orig.config.yaml 2024-04-14T09:48:43.568 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi/7638510 2024-04-14T09:48:43.568 INFO:teuthology.dispatcher.supervisor:Job PID: 2618605 2024-04-14T09:48:43.568 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-14T09:50:43.667 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-14T09:52:43.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-14T09:54:44.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-14T09:56:44.168 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-14T09:58:44.333 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-14T10:00:44.498 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-14T10:02:44.660 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-14T10:02:44.733 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1