2024-04-18T09:46:28.909 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-18T09:46:28.910 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T09:46:29.086 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb17da18c10>, signals=[15]) 2024-04-18T09:46:29.087 INFO:teuthology.lock.ops:Start node 'smithi040.front.sepia.ceph.com' reimaging 2024-04-18T09:46:29.087 INFO:teuthology.lock.ops:Updating [smithi040.front.sepia.ceph.com]: reset os type and version on server 2024-04-18T09:46:29.087 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server 2024-04-18T09:46:29.107 INFO:teuthology.lock.ops:Start node 'smithi066.front.sepia.ceph.com' reimaging 2024-04-18T09:46:29.107 INFO:teuthology.lock.ops:Updating [smithi066.front.sepia.ceph.com]: reset os type and version on server 2024-04-18T09:46:29.107 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server 2024-04-18T09:46:29.131 INFO:teuthology.lock.ops:Start node 'smithi137.front.sepia.ceph.com' reimaging 2024-04-18T09:46:29.131 INFO:teuthology.lock.ops:Updating [smithi137.front.sepia.ceph.com]: reset os type and version on server 2024-04-18T09:46:29.131 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server 2024-04-18T09:46:29.221 DEBUG:teuthology.provision.fog.smithi040:Requesting image smithi_centos_9.stream (ID 10) 2024-04-18T09:46:29.232 DEBUG:teuthology.provision.fog.smithi066:Requesting image smithi_centos_9.stream (ID 10) 2024-04-18T09:46:29.248 DEBUG:teuthology.provision.fog.smithi137:Requesting image smithi_centos_9.stream (ID 10) 2024-04-18T09:46:29.266 INFO:teuthology.provision.fog.smithi040:Scheduling deploy of centos 9.stream 2024-04-18T09:46:29.270 INFO:teuthology.provision.fog.smithi066:Scheduling deploy of centos 9.stream 2024-04-18T09:46:29.292 INFO:teuthology.provision.fog.smithi137:Scheduling deploy of centos 9.stream 2024-04-18T09:46:29.617 INFO:teuthology.orchestra.console.smithi137:Power off 2024-04-18T09:46:29.618 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-18T09:46:29.632 INFO:teuthology.orchestra.console.smithi040:Power off 2024-04-18T09:46:29.632 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-18T09:46:29.645 INFO:teuthology.orchestra.console.smithi066:Power off 2024-04-18T09:46:29.645 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-18T09:46:29.653 DEBUG:teuthology.orchestra.console.smithi137:power off output: Chassis Power Control: Down/Off 2024-04-18T09:46:29.653 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T09:46:29.661 DEBUG:teuthology.orchestra.console.smithi040:power off output: Chassis Power Control: Down/Off 2024-04-18T09:46:29.662 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T09:46:29.670 DEBUG:teuthology.orchestra.console.smithi066:power off output: Chassis Power Control: Down/Off 2024-04-18T09:46:29.671 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T09:46:29.679 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is off 2024-04-18T09:46:29.686 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on 2024-04-18T09:46:29.691 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is off 2024-04-18T09:46:29.780 INFO:teuthology.orchestra.console.smithi137:Power off completed 2024-04-18T09:46:29.792 INFO:teuthology.orchestra.console.smithi066:Power off completed 2024-04-18T09:46:29.881 INFO:teuthology.orchestra.console.smithi137:Power on 2024-04-18T09:46:29.881 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-18T09:46:29.892 INFO:teuthology.orchestra.console.smithi066:Power on 2024-04-18T09:46:29.893 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-18T09:46:29.905 DEBUG:teuthology.orchestra.console.smithi137:power on output: Chassis Power Control: Up/On 2024-04-18T09:46:29.905 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T09:46:29.918 DEBUG:teuthology.orchestra.console.smithi066:power on output: Chassis Power Control: Up/On 2024-04-18T09:46:29.918 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T09:46:29.929 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is off 2024-04-18T09:46:29.940 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is off 2024-04-18T09:46:33.690 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T09:46:33.807 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off 2024-04-18T09:46:33.908 INFO:teuthology.orchestra.console.smithi040:Power off completed 2024-04-18T09:46:33.930 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T09:46:33.940 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T09:46:34.009 INFO:teuthology.orchestra.console.smithi040:Power on 2024-04-18T09:46:34.009 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-18T09:46:34.031 DEBUG:teuthology.orchestra.console.smithi040:power on output: Chassis Power Control: Up/On 2024-04-18T09:46:34.032 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T09:46:34.041 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is off 2024-04-18T09:46:34.052 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is on 2024-04-18T09:46:34.056 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off 2024-04-18T09:46:34.152 INFO:teuthology.orchestra.console.smithi066:Power on completed 2024-04-18T09:46:34.254 INFO:teuthology.provision.fog.smithi066:Waiting for deploy to finish 2024-04-18T09:46:38.044 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T09:46:38.057 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T09:46:38.166 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off 2024-04-18T09:46:38.237 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is on 2024-04-18T09:46:38.338 INFO:teuthology.orchestra.console.smithi137:Power on completed 2024-04-18T09:46:38.439 INFO:teuthology.provision.fog.smithi137:Waiting for deploy to finish 2024-04-18T09:46:42.170 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T09:46:42.279 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on 2024-04-18T09:46:42.380 INFO:teuthology.orchestra.console.smithi040:Power on completed 2024-04-18T09:46:42.480 INFO:teuthology.provision.fog.smithi040:Waiting for deploy to finish 2024-04-18T09:49:10.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:49:13.694 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2024-04-18T09:49:19.701 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:49:22.782 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2024-04-18T09:49:28.789 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:49:31.870 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2024-04-18T09:49:37.872 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:49:40.926 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2024-04-18T09:49:46.930 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:49:49.983 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2024-04-18T09:49:55.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:49:59.070 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2024-04-18T09:50:00.113 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:50:05.077 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:50:08.158 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2024-04-18T09:50:14.163 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:50:18.654 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40 2024-04-18T09:50:22.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:50:24.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:50:25.214 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-04-18T09:50:27.714 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40 2024-04-18T09:50:31.219 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:50:33.718 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:50:34.270 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-04-18T09:50:36.798 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40 2024-04-18T09:50:40.275 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:50:42.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:50:43.326 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-04-18T09:50:45.854 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40 2024-04-18T09:50:49.331 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:50:51.856 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:50:52.382 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-04-18T09:50:58.387 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:51:01.438 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-04-18T09:51:07.443 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:51:10.494 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-04-18T09:51:14.169 WARNING:teuthology.provision.fog.smithi137:timed out 2024-04-18T09:51:16.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:51:19.550 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-04-18T09:51:20.171 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:51:20.394 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-18T09:51:20.395 DEBUG:teuthology.orchestra.run.smithi137:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-18T09:51:20.717 INFO:teuthology.provision.fog.smithi137:Node is ready 2024-04-18T09:51:20.717 DEBUG:teuthology.orchestra.run.smithi137:> hostname 2024-04-18T09:51:20.731 INFO:teuthology.orchestra.run.smithi137.stdout:smithi137.front.sepia.ceph.com 2024-04-18T09:51:20.731 DEBUG:teuthology.orchestra.run.smithi137:> grep smithi137.front.sepia.ceph.com /etc/hosts 2024-04-18T09:51:20.786 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.15.137 smithi137.front.sepia.ceph.com smithi137 2024-04-18T09:51:20.787 DEBUG:teuthology.orchestra.run.smithi137:> sudo hostname smithi137 2024-04-18T09:51:20.908 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i -e 's/smithi137.front.sepia.ceph.com/smithi137/g' /etc/hosts 2024-04-18T09:51:20.935 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i -e 's/172.21.15.137/172.21.15.137/g' /etc/hosts 2024-04-18T09:51:21.003 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i -e 's/smithi137.front.sepia.ceph.com/smithi137/g' /etc/hostname 2024-04-18T09:51:21.070 DEBUG:teuthology.orchestra.run.smithi137:> sudo hostname smithi137 2024-04-18T09:51:21.136 DEBUG:teuthology.orchestra.run.smithi137:> cat /etc/os-release 2024-04-18T09:51:21.191 INFO:teuthology.orchestra.run.smithi137.stdout:NAME="CentOS Stream" 2024-04-18T09:51:21.191 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION="9" 2024-04-18T09:51:21.191 INFO:teuthology.orchestra.run.smithi137.stdout:ID="centos" 2024-04-18T09:51:21.191 INFO:teuthology.orchestra.run.smithi137.stdout:ID_LIKE="rhel fedora" 2024-04-18T09:51:21.192 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_ID="9" 2024-04-18T09:51:21.192 INFO:teuthology.orchestra.run.smithi137.stdout:PLATFORM_ID="platform:el9" 2024-04-18T09:51:21.192 INFO:teuthology.orchestra.run.smithi137.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-18T09:51:21.192 INFO:teuthology.orchestra.run.smithi137.stdout:ANSI_COLOR="0;31" 2024-04-18T09:51:21.192 INFO:teuthology.orchestra.run.smithi137.stdout:LOGO="fedora-logo-icon" 2024-04-18T09:51:21.192 INFO:teuthology.orchestra.run.smithi137.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-18T09:51:21.192 INFO:teuthology.orchestra.run.smithi137.stdout:HOME_URL="https://centos.org/" 2024-04-18T09:51:21.192 INFO:teuthology.orchestra.run.smithi137.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T09:51:21.192 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-18T09:51:21.192 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-18T09:51:21.193 INFO:teuthology.provision.fog.smithi137:Deploy complete! 2024-04-18T09:51:21.194 DEBUG:teuthology.parallel:result is None 2024-04-18T09:51:25.557 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:51:28.638 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-04-18T09:51:34.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:51:37.726 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-04-18T09:51:43.730 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:51:51.866 WARNING:teuthology.provision.fog.smithi040:timed out 2024-04-18T09:51:57.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:51:58.092 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-18T09:51:58.093 DEBUG:teuthology.orchestra.run.smithi040:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-18T09:51:58.445 INFO:teuthology.provision.fog.smithi040:Node is ready 2024-04-18T09:51:58.445 DEBUG:teuthology.orchestra.run.smithi040:> hostname 2024-04-18T09:51:58.461 INFO:teuthology.orchestra.run.smithi040.stdout:smithi040.front.sepia.ceph.com 2024-04-18T09:51:58.461 DEBUG:teuthology.orchestra.run.smithi040:> grep smithi040.front.sepia.ceph.com /etc/hosts 2024-04-18T09:51:58.517 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40 smithi040.front.sepia.ceph.com smithi040 2024-04-18T09:51:58.517 DEBUG:teuthology.orchestra.run.smithi040:> sudo hostname smithi040 2024-04-18T09:51:58.637 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/smithi040.front.sepia.ceph.com/smithi040/g' /etc/hosts 2024-04-18T09:51:58.669 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/172.21.15.40/172.21.15.40/g' /etc/hosts 2024-04-18T09:51:58.741 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/smithi040.front.sepia.ceph.com/smithi040/g' /etc/hostname 2024-04-18T09:51:58.812 DEBUG:teuthology.orchestra.run.smithi040:> sudo hostname smithi040 2024-04-18T09:51:58.883 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release 2024-04-18T09:51:58.938 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="CentOS Stream" 2024-04-18T09:51:58.938 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="9" 2024-04-18T09:51:58.938 INFO:teuthology.orchestra.run.smithi040.stdout:ID="centos" 2024-04-18T09:51:58.938 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE="rhel fedora" 2024-04-18T09:51:58.938 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="9" 2024-04-18T09:51:58.938 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM_ID="platform:el9" 2024-04-18T09:51:58.938 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-18T09:51:58.938 INFO:teuthology.orchestra.run.smithi040.stdout:ANSI_COLOR="0;31" 2024-04-18T09:51:58.938 INFO:teuthology.orchestra.run.smithi040.stdout:LOGO="fedora-logo-icon" 2024-04-18T09:51:58.938 INFO:teuthology.orchestra.run.smithi040.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-18T09:51:58.938 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://centos.org/" 2024-04-18T09:51:58.939 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T09:51:58.939 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-18T09:51:58.939 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-18T09:51:58.939 INFO:teuthology.provision.fog.smithi040:Deploy complete! 2024-04-18T09:51:58.940 DEBUG:teuthology.parallel:result is None 2024-04-18T09:52:43.775 WARNING:teuthology.provision.fog.smithi066:timed out 2024-04-18T09:52:49.779 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:52:50.004 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-18T09:52:50.004 DEBUG:teuthology.orchestra.run.smithi066:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-18T09:52:50.336 INFO:teuthology.provision.fog.smithi066:Node is ready 2024-04-18T09:52:50.336 DEBUG:teuthology.orchestra.run.smithi066:> hostname 2024-04-18T09:52:50.351 INFO:teuthology.orchestra.run.smithi066.stdout:smithi066.front.sepia.ceph.com 2024-04-18T09:52:50.351 DEBUG:teuthology.orchestra.run.smithi066:> grep smithi066.front.sepia.ceph.com /etc/hosts 2024-04-18T09:52:50.406 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66 smithi066.front.sepia.ceph.com smithi066 2024-04-18T09:52:50.407 DEBUG:teuthology.orchestra.run.smithi066:> sudo hostname smithi066 2024-04-18T09:52:50.510 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i -e 's/smithi066.front.sepia.ceph.com/smithi066/g' /etc/hosts 2024-04-18T09:52:50.542 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i -e 's/172.21.15.66/172.21.15.66/g' /etc/hosts 2024-04-18T09:52:50.613 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i -e 's/smithi066.front.sepia.ceph.com/smithi066/g' /etc/hostname 2024-04-18T09:52:50.684 DEBUG:teuthology.orchestra.run.smithi066:> sudo hostname smithi066 2024-04-18T09:52:50.754 DEBUG:teuthology.orchestra.run.smithi066:> cat /etc/os-release 2024-04-18T09:52:50.809 INFO:teuthology.orchestra.run.smithi066.stdout:NAME="CentOS Stream" 2024-04-18T09:52:50.809 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION="9" 2024-04-18T09:52:50.809 INFO:teuthology.orchestra.run.smithi066.stdout:ID="centos" 2024-04-18T09:52:50.809 INFO:teuthology.orchestra.run.smithi066.stdout:ID_LIKE="rhel fedora" 2024-04-18T09:52:50.809 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_ID="9" 2024-04-18T09:52:50.809 INFO:teuthology.orchestra.run.smithi066.stdout:PLATFORM_ID="platform:el9" 2024-04-18T09:52:50.809 INFO:teuthology.orchestra.run.smithi066.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-18T09:52:50.810 INFO:teuthology.orchestra.run.smithi066.stdout:ANSI_COLOR="0;31" 2024-04-18T09:52:50.810 INFO:teuthology.orchestra.run.smithi066.stdout:LOGO="fedora-logo-icon" 2024-04-18T09:52:50.810 INFO:teuthology.orchestra.run.smithi066.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-18T09:52:50.810 INFO:teuthology.orchestra.run.smithi066.stdout:HOME_URL="https://centos.org/" 2024-04-18T09:52:50.810 INFO:teuthology.orchestra.run.smithi066.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T09:52:50.810 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-18T09:52:50.810 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-18T09:52:50.810 INFO:teuthology.provision.fog.smithi066:Deploy complete! 2024-04-18T09:52:50.811 DEBUG:teuthology.parallel:result is None 2024-04-18T09:52:51.034 INFO:teuthology.lock.ops:Checking smithi040.front.sepia.ceph.com 2024-04-18T09:52:51.034 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-18T09:52:51.051 INFO:teuthology.lock.ops:Checking smithi066.front.sepia.ceph.com 2024-04-18T09:52:51.051 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-18T09:52:51.068 INFO:teuthology.lock.ops:Checking smithi137.front.sepia.ceph.com 2024-04-18T09:52:51.068 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-18T09:52:51.094 INFO:teuthology.lock.ops:Updating [smithi040.front.sepia.ceph.com]: set os type and version on server 2024-04-18T09:52:51.094 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-04-18T09:52:51.095 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:52:51.197 DEBUG:teuthology.orchestra.run.smithi040:> true 2024-04-18T09:52:51.380 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-04-18T09:52:51.381 DEBUG:teuthology.orchestra.run.smithi040:> uname -m 2024-04-18T09:52:51.436 INFO:teuthology.orchestra.run.smithi040.stdout:x86_64 2024-04-18T09:52:51.436 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release 2024-04-18T09:52:51.490 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="CentOS Stream" 2024-04-18T09:52:51.491 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="9" 2024-04-18T09:52:51.491 INFO:teuthology.orchestra.run.smithi040.stdout:ID="centos" 2024-04-18T09:52:51.491 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE="rhel fedora" 2024-04-18T09:52:51.491 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="9" 2024-04-18T09:52:51.491 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM_ID="platform:el9" 2024-04-18T09:52:51.491 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-18T09:52:51.491 INFO:teuthology.orchestra.run.smithi040.stdout:ANSI_COLOR="0;31" 2024-04-18T09:52:51.491 INFO:teuthology.orchestra.run.smithi040.stdout:LOGO="fedora-logo-icon" 2024-04-18T09:52:51.491 INFO:teuthology.orchestra.run.smithi040.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-18T09:52:51.491 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://centos.org/" 2024-04-18T09:52:51.491 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T09:52:51.491 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-18T09:52:51.491 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-18T09:52:51.492 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server 2024-04-18T09:52:51.510 INFO:teuthology.lock.ops:Updating [smithi066.front.sepia.ceph.com]: set os type and version on server 2024-04-18T09:52:51.510 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-04-18T09:52:51.511 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:52:51.610 DEBUG:teuthology.orchestra.run.smithi066:> true 2024-04-18T09:52:51.678 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-04-18T09:52:51.678 DEBUG:teuthology.orchestra.run.smithi066:> uname -m 2024-04-18T09:52:51.733 INFO:teuthology.orchestra.run.smithi066.stdout:x86_64 2024-04-18T09:52:51.734 DEBUG:teuthology.orchestra.run.smithi066:> cat /etc/os-release 2024-04-18T09:52:51.789 INFO:teuthology.orchestra.run.smithi066.stdout:NAME="CentOS Stream" 2024-04-18T09:52:51.789 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION="9" 2024-04-18T09:52:51.789 INFO:teuthology.orchestra.run.smithi066.stdout:ID="centos" 2024-04-18T09:52:51.789 INFO:teuthology.orchestra.run.smithi066.stdout:ID_LIKE="rhel fedora" 2024-04-18T09:52:51.789 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_ID="9" 2024-04-18T09:52:51.789 INFO:teuthology.orchestra.run.smithi066.stdout:PLATFORM_ID="platform:el9" 2024-04-18T09:52:51.789 INFO:teuthology.orchestra.run.smithi066.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-18T09:52:51.790 INFO:teuthology.orchestra.run.smithi066.stdout:ANSI_COLOR="0;31" 2024-04-18T09:52:51.790 INFO:teuthology.orchestra.run.smithi066.stdout:LOGO="fedora-logo-icon" 2024-04-18T09:52:51.790 INFO:teuthology.orchestra.run.smithi066.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-18T09:52:51.790 INFO:teuthology.orchestra.run.smithi066.stdout:HOME_URL="https://centos.org/" 2024-04-18T09:52:51.790 INFO:teuthology.orchestra.run.smithi066.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T09:52:51.790 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-18T09:52:51.790 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-18T09:52:51.790 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server 2024-04-18T09:52:51.810 INFO:teuthology.lock.ops:Updating [smithi137.front.sepia.ceph.com]: set os type and version on server 2024-04-18T09:52:51.810 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-04-18T09:52:51.811 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:52:51.899 DEBUG:teuthology.orchestra.run.smithi137:> true 2024-04-18T09:52:52.072 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-04-18T09:52:52.072 DEBUG:teuthology.orchestra.run.smithi137:> uname -m 2024-04-18T09:52:52.127 INFO:teuthology.orchestra.run.smithi137.stdout:x86_64 2024-04-18T09:52:52.127 DEBUG:teuthology.orchestra.run.smithi137:> cat /etc/os-release 2024-04-18T09:52:52.182 INFO:teuthology.orchestra.run.smithi137.stdout:NAME="CentOS Stream" 2024-04-18T09:52:52.182 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION="9" 2024-04-18T09:52:52.182 INFO:teuthology.orchestra.run.smithi137.stdout:ID="centos" 2024-04-18T09:52:52.182 INFO:teuthology.orchestra.run.smithi137.stdout:ID_LIKE="rhel fedora" 2024-04-18T09:52:52.182 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_ID="9" 2024-04-18T09:52:52.182 INFO:teuthology.orchestra.run.smithi137.stdout:PLATFORM_ID="platform:el9" 2024-04-18T09:52:52.182 INFO:teuthology.orchestra.run.smithi137.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-18T09:52:52.182 INFO:teuthology.orchestra.run.smithi137.stdout:ANSI_COLOR="0;31" 2024-04-18T09:52:52.182 INFO:teuthology.orchestra.run.smithi137.stdout:LOGO="fedora-logo-icon" 2024-04-18T09:52:52.182 INFO:teuthology.orchestra.run.smithi137.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-18T09:52:52.183 INFO:teuthology.orchestra.run.smithi137.stdout:HOME_URL="https://centos.org/" 2024-04-18T09:52:52.183 INFO:teuthology.orchestra.run.smithi137.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T09:52:52.183 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-18T09:52:52.183 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-18T09:52:52.183 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server 2024-04-18T09:52:52.202 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T09:52:52.306 INFO:teuthology.dispatcher.supervisor:Running job 7660936 2024-04-18T09:52:52.306 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-04-17_20:24:14-fs-main-distro-default-smithi/7660936 --name teuthology-2024-04-17_20:24:14-fs-main-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-workunit/suites/iozone}} -- /home/teuthworker/archive/teuthology-2024-04-17_20:24:14-fs-main-distro-default-smithi/7660936/orig.config.yaml 2024-04-18T09:52:52.309 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-04-17_20:24:14-fs-main-distro-default-smithi/7660936 2024-04-18T09:52:52.309 INFO:teuthology.dispatcher.supervisor:Job PID: 3193262 2024-04-18T09:52:52.309 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-18T09:54:52.411 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T09:56:52.591 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T09:58:52.763 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T10:00:52.935 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T10:02:53.098 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T10:02:53.167 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1