2024-04-10T19:54:54.933 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-10T19:54:54.934 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-10T19:54:55.155 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7efe107eec10>, signals=[15]) 2024-04-10T19:54:55.156 INFO:teuthology.lock.ops:Start node 'smithi044.front.sepia.ceph.com' reimaging 2024-04-10T19:54:55.156 INFO:teuthology.lock.ops:Updating [smithi044.front.sepia.ceph.com]: reset os type and version on server 2024-04-10T19:54:55.156 INFO:teuthology.lock.ops:Updating smithi044.front.sepia.ceph.com on lock server 2024-04-10T19:54:55.194 INFO:teuthology.lock.ops:Start node 'smithi063.front.sepia.ceph.com' reimaging 2024-04-10T19:54:55.195 INFO:teuthology.lock.ops:Updating [smithi063.front.sepia.ceph.com]: reset os type and version on server 2024-04-10T19:54:55.195 INFO:teuthology.lock.ops:Updating smithi063.front.sepia.ceph.com on lock server 2024-04-10T19:54:55.235 INFO:teuthology.lock.ops:Start node 'smithi069.front.sepia.ceph.com' reimaging 2024-04-10T19:54:55.236 INFO:teuthology.lock.ops:Updating [smithi069.front.sepia.ceph.com]: reset os type and version on server 2024-04-10T19:54:55.236 INFO:teuthology.lock.ops:Updating smithi069.front.sepia.ceph.com on lock server 2024-04-10T19:54:55.365 DEBUG:teuthology.provision.fog.smithi044:Requesting image smithi_centos_9.stream (ID 10) 2024-04-10T19:54:55.419 INFO:teuthology.provision.fog.smithi044:Scheduling deploy of centos 9.stream 2024-04-10T19:54:55.434 DEBUG:teuthology.provision.fog.smithi063:Requesting image smithi_centos_9.stream (ID 10) 2024-04-10T19:54:55.447 DEBUG:teuthology.provision.fog.smithi069:Requesting image smithi_centos_9.stream (ID 10) 2024-04-10T19:54:55.502 INFO:teuthology.provision.fog.smithi069:Scheduling deploy of centos 9.stream 2024-04-10T19:54:55.516 INFO:teuthology.provision.fog.smithi063:Scheduling deploy of centos 9.stream 2024-04-10T19:54:55.790 INFO:teuthology.orchestra.console.smithi044:Power off 2024-04-10T19:54:55.791 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-10T19:54:55.829 DEBUG:teuthology.orchestra.console.smithi044:power off output: Chassis Power Control: Down/Off 2024-04-10T19:54:55.829 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-10T19:54:55.842 INFO:teuthology.orchestra.console.smithi063:Power off 2024-04-10T19:54:55.842 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-10T19:54:55.855 INFO:teuthology.orchestra.console.smithi069:Power off 2024-04-10T19:54:55.855 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-10T19:54:55.866 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is off 2024-04-10T19:54:55.873 DEBUG:teuthology.orchestra.console.smithi063:power off output: Chassis Power Control: Down/Off 2024-04-10T19:54:55.874 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-10T19:54:55.885 DEBUG:teuthology.orchestra.console.smithi069:power off output: Chassis Power Control: Down/Off 2024-04-10T19:54:55.886 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-10T19:54:55.906 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is off 2024-04-10T19:54:55.917 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off 2024-04-10T19:54:55.967 INFO:teuthology.orchestra.console.smithi044:Power off completed 2024-04-10T19:54:56.007 INFO:teuthology.orchestra.console.smithi063:Power off completed 2024-04-10T19:54:56.017 INFO:teuthology.orchestra.console.smithi069:Power off completed 2024-04-10T19:54:56.069 INFO:teuthology.orchestra.console.smithi044:Power on 2024-04-10T19:54:56.069 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-10T19:54:56.103 DEBUG:teuthology.orchestra.console.smithi044:power on output: Chassis Power Control: Up/On 2024-04-10T19:54:56.103 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-10T19:54:56.111 INFO:teuthology.orchestra.console.smithi063:Power on 2024-04-10T19:54:56.111 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-10T19:54:56.118 INFO:teuthology.orchestra.console.smithi069:Power on 2024-04-10T19:54:56.118 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-10T19:54:56.135 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is off 2024-04-10T19:54:56.141 DEBUG:teuthology.orchestra.console.smithi063:power on output: Chassis Power Control: Up/On 2024-04-10T19:54:56.141 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-10T19:54:56.155 DEBUG:teuthology.orchestra.console.smithi069:power on output: Chassis Power Control: Up/On 2024-04-10T19:54:56.155 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-10T19:54:56.183 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is off 2024-04-10T19:54:56.193 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off 2024-04-10T19:55:00.138 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-10T19:55:00.184 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-10T19:55:00.193 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-10T19:55:00.247 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is on 2024-04-10T19:55:00.292 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is on 2024-04-10T19:55:00.300 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off 2024-04-10T19:55:00.348 INFO:teuthology.orchestra.console.smithi044:Power on completed 2024-04-10T19:55:00.392 INFO:teuthology.orchestra.console.smithi063:Power on completed 2024-04-10T19:55:00.449 INFO:teuthology.provision.fog.smithi044:Waiting for deploy to finish 2024-04-10T19:55:00.493 INFO:teuthology.provision.fog.smithi063:Waiting for deploy to finish 2024-04-10T19:55:04.302 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-10T19:55:04.413 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on 2024-04-10T19:55:04.514 INFO:teuthology.orchestra.console.smithi069:Power on completed 2024-04-10T19:55:04.615 INFO:teuthology.provision.fog.smithi069:Waiting for deploy to finish 2024-04-10T19:57:32.537 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T19:57:35.614 WARNING:teuthology.provision.fog.smithi044:[Errno None] Unable to connect to port 22 on 172.21.15.44 2024-04-10T19:57:41.619 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T19:57:44.702 WARNING:teuthology.provision.fog.smithi044:[Errno None] Unable to connect to port 22 on 172.21.15.44 2024-04-10T19:57:47.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T19:57:50.707 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T19:57:50.782 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-04-10T19:57:51.616 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T19:57:53.790 WARNING:teuthology.provision.fog.smithi044:[Errno None] Unable to connect to port 22 on 172.21.15.44 2024-04-10T19:57:54.686 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2024-04-10T19:57:56.785 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T19:57:59.795 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T19:57:59.870 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-04-10T19:58:00.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T19:58:02.878 WARNING:teuthology.provision.fog.smithi044:[Errno None] Unable to connect to port 22 on 172.21.15.44 2024-04-10T19:58:03.774 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2024-04-10T19:58:05.872 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T19:58:08.883 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T19:58:08.958 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-04-10T19:58:09.777 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T19:58:11.966 WARNING:teuthology.provision.fog.smithi044:[Errno None] Unable to connect to port 22 on 172.21.15.44 2024-04-10T19:58:12.862 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2024-04-10T19:58:14.961 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T19:58:17.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T19:58:18.046 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-04-10T19:58:18.865 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T19:58:21.054 WARNING:teuthology.provision.fog.smithi044:[Errno None] Unable to connect to port 22 on 172.21.15.44 2024-04-10T19:58:21.950 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2024-04-10T19:58:24.048 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T19:58:27.059 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T19:58:27.134 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-04-10T19:58:27.953 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T19:58:31.038 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2024-04-10T19:58:33.137 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T19:58:36.222 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-04-10T19:58:37.040 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T19:58:40.126 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2024-04-10T19:58:42.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T19:58:46.132 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T19:58:56.286 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2024-04-10T19:59:00.638 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-04-10T19:59:02.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T19:59:05.374 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2024-04-10T19:59:06.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T19:59:09.726 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-04-10T19:59:11.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T19:59:14.462 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2024-04-10T19:59:15.729 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T19:59:18.814 WARNING:teuthology.provision.fog.smithi063:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-04-10T19:59:20.465 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T19:59:22.834 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-10T19:59:22.835 DEBUG:teuthology.orchestra.run.smithi069:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-10T19:59:24.816 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T19:59:25.095 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-10T19:59:25.096 DEBUG:teuthology.orchestra.run.smithi063:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-10T19:59:27.072 WARNING:teuthology.provision.fog.smithi044:timed out 2024-04-10T19:59:33.073 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T19:59:33.333 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-10T19:59:33.333 DEBUG:teuthology.orchestra.run.smithi044:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-10T19:59:33.662 INFO:teuthology.provision.fog.smithi044:Node is ready 2024-04-10T19:59:33.662 DEBUG:teuthology.orchestra.run.smithi044:> hostname 2024-04-10T19:59:33.677 INFO:teuthology.orchestra.run.smithi044.stdout:smithi044.front.sepia.ceph.com 2024-04-10T19:59:33.678 DEBUG:teuthology.orchestra.run.smithi044:> grep smithi044.front.sepia.ceph.com /etc/hosts 2024-04-10T19:59:33.733 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44 smithi044.front.sepia.ceph.com smithi044 2024-04-10T19:59:33.734 DEBUG:teuthology.orchestra.run.smithi044:> sudo hostname smithi044 2024-04-10T19:59:33.854 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i -e 's/smithi044.front.sepia.ceph.com/smithi044/g' /etc/hosts 2024-04-10T19:59:33.885 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i -e 's/172.21.15.44/172.21.15.44/g' /etc/hosts 2024-04-10T19:59:33.957 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i -e 's/smithi044.front.sepia.ceph.com/smithi044/g' /etc/hostname 2024-04-10T19:59:34.027 DEBUG:teuthology.orchestra.run.smithi044:> sudo hostname smithi044 2024-04-10T19:59:34.098 DEBUG:teuthology.orchestra.run.smithi044:> cat /etc/os-release 2024-04-10T19:59:34.153 INFO:teuthology.orchestra.run.smithi044.stdout:NAME="CentOS Stream" 2024-04-10T19:59:34.153 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION="9" 2024-04-10T19:59:34.153 INFO:teuthology.orchestra.run.smithi044.stdout:ID="centos" 2024-04-10T19:59:34.153 INFO:teuthology.orchestra.run.smithi044.stdout:ID_LIKE="rhel fedora" 2024-04-10T19:59:34.153 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION_ID="9" 2024-04-10T19:59:34.153 INFO:teuthology.orchestra.run.smithi044.stdout:PLATFORM_ID="platform:el9" 2024-04-10T19:59:34.153 INFO:teuthology.orchestra.run.smithi044.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-10T19:59:34.153 INFO:teuthology.orchestra.run.smithi044.stdout:ANSI_COLOR="0;31" 2024-04-10T19:59:34.153 INFO:teuthology.orchestra.run.smithi044.stdout:LOGO="fedora-logo-icon" 2024-04-10T19:59:34.153 INFO:teuthology.orchestra.run.smithi044.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-10T19:59:34.153 INFO:teuthology.orchestra.run.smithi044.stdout:HOME_URL="https://centos.org/" 2024-04-10T19:59:34.154 INFO:teuthology.orchestra.run.smithi044.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-10T19:59:34.154 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-10T19:59:34.154 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-10T19:59:34.154 INFO:teuthology.provision.fog.smithi044:Deploy complete! 2024-04-10T19:59:34.156 DEBUG:teuthology.parallel:result is None 2024-04-10T19:59:40.459 INFO:teuthology.provision.fog.smithi063:Node is ready 2024-04-10T19:59:40.459 DEBUG:teuthology.orchestra.run.smithi063:> hostname 2024-04-10T19:59:40.477 INFO:teuthology.orchestra.run.smithi063.stdout:smithi046 2024-04-10T19:59:40.477 DEBUG:teuthology.orchestra.run.smithi063:> grep smithi046 /etc/hosts 2024-04-10T19:59:40.536 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2024-04-10T19:59:40.537 DEBUG:teuthology.orchestra.run.smithi063:> sudo hostname smithi063 2024-04-10T19:59:40.684 DEBUG:teuthology.orchestra.run.smithi063:> sudo sed -i -e 's/smithi046/smithi063/g' /etc/hosts 2024-04-10T19:59:40.716 DEBUG:teuthology.orchestra.run.smithi063:> sudo sed -i -e 's/172.21.15.46/172.21.15.63/g' /etc/hosts 2024-04-10T19:59:40.789 DEBUG:teuthology.orchestra.run.smithi063:> sudo sed -i -e 's/smithi046/smithi063/g' /etc/hostname 2024-04-10T19:59:40.860 DEBUG:teuthology.orchestra.run.smithi063:> sudo hostname smithi063 2024-04-10T19:59:40.931 DEBUG:teuthology.orchestra.run.smithi063:> cat /etc/os-release 2024-04-10T19:59:40.987 INFO:teuthology.orchestra.run.smithi063.stdout:NAME="CentOS Stream" 2024-04-10T19:59:40.987 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION="9" 2024-04-10T19:59:40.987 INFO:teuthology.orchestra.run.smithi063.stdout:ID="centos" 2024-04-10T19:59:40.987 INFO:teuthology.orchestra.run.smithi063.stdout:ID_LIKE="rhel fedora" 2024-04-10T19:59:40.987 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION_ID="9" 2024-04-10T19:59:40.987 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM_ID="platform:el9" 2024-04-10T19:59:40.987 INFO:teuthology.orchestra.run.smithi063.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-10T19:59:40.987 INFO:teuthology.orchestra.run.smithi063.stdout:ANSI_COLOR="0;31" 2024-04-10T19:59:40.987 INFO:teuthology.orchestra.run.smithi063.stdout:LOGO="fedora-logo-icon" 2024-04-10T19:59:40.987 INFO:teuthology.orchestra.run.smithi063.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-10T19:59:40.987 INFO:teuthology.orchestra.run.smithi063.stdout:HOME_URL="https://centos.org/" 2024-04-10T19:59:40.988 INFO:teuthology.orchestra.run.smithi063.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-10T19:59:40.988 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-10T19:59:40.988 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-10T19:59:40.988 INFO:teuthology.provision.fog.smithi063:Deploy complete! 2024-04-10T19:59:40.988 DEBUG:teuthology.parallel:result is None 2024-04-10T19:59:43.215 INFO:teuthology.provision.fog.smithi069:Node is ready 2024-04-10T19:59:43.215 DEBUG:teuthology.orchestra.run.smithi069:> hostname 2024-04-10T19:59:43.233 INFO:teuthology.orchestra.run.smithi069.stdout:smithi046 2024-04-10T19:59:43.233 DEBUG:teuthology.orchestra.run.smithi069:> grep smithi046 /etc/hosts 2024-04-10T19:59:43.289 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2024-04-10T19:59:43.289 DEBUG:teuthology.orchestra.run.smithi069:> sudo hostname smithi069 2024-04-10T19:59:43.474 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i -e 's/smithi046/smithi069/g' /etc/hosts 2024-04-10T19:59:43.507 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i -e 's/172.21.15.46/172.21.15.69/g' /etc/hosts 2024-04-10T19:59:43.574 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i -e 's/smithi046/smithi069/g' /etc/hostname 2024-04-10T19:59:43.641 DEBUG:teuthology.orchestra.run.smithi069:> sudo hostname smithi069 2024-04-10T19:59:43.707 DEBUG:teuthology.orchestra.run.smithi069:> cat /etc/os-release 2024-04-10T19:59:43.761 INFO:teuthology.orchestra.run.smithi069.stdout:NAME="CentOS Stream" 2024-04-10T19:59:43.761 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION="9" 2024-04-10T19:59:43.761 INFO:teuthology.orchestra.run.smithi069.stdout:ID="centos" 2024-04-10T19:59:43.761 INFO:teuthology.orchestra.run.smithi069.stdout:ID_LIKE="rhel fedora" 2024-04-10T19:59:43.761 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION_ID="9" 2024-04-10T19:59:43.761 INFO:teuthology.orchestra.run.smithi069.stdout:PLATFORM_ID="platform:el9" 2024-04-10T19:59:43.761 INFO:teuthology.orchestra.run.smithi069.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-10T19:59:43.761 INFO:teuthology.orchestra.run.smithi069.stdout:ANSI_COLOR="0;31" 2024-04-10T19:59:43.761 INFO:teuthology.orchestra.run.smithi069.stdout:LOGO="fedora-logo-icon" 2024-04-10T19:59:43.761 INFO:teuthology.orchestra.run.smithi069.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-10T19:59:43.762 INFO:teuthology.orchestra.run.smithi069.stdout:HOME_URL="https://centos.org/" 2024-04-10T19:59:43.762 INFO:teuthology.orchestra.run.smithi069.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-10T19:59:43.762 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-10T19:59:43.762 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-10T19:59:43.762 INFO:teuthology.provision.fog.smithi069:Deploy complete! 2024-04-10T19:59:43.762 DEBUG:teuthology.parallel:result is None 2024-04-10T19:59:44.261 INFO:teuthology.lock.ops:Checking smithi044.front.sepia.ceph.com 2024-04-10T19:59:44.261 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-10T19:59:44.296 INFO:teuthology.lock.ops:Checking smithi063.front.sepia.ceph.com 2024-04-10T19:59:44.296 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-10T19:59:44.329 INFO:teuthology.lock.ops:Checking smithi069.front.sepia.ceph.com 2024-04-10T19:59:44.329 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-10T19:59:44.364 INFO:teuthology.lock.ops:Updating [smithi044.front.sepia.ceph.com]: set os type and version on server 2024-04-10T19:59:44.364 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-04-10T19:59:44.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T19:59:44.478 DEBUG:teuthology.orchestra.run.smithi044:> true 2024-04-10T19:59:44.656 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-04-10T19:59:44.656 DEBUG:teuthology.orchestra.run.smithi044:> uname -m 2024-04-10T19:59:44.711 INFO:teuthology.orchestra.run.smithi044.stdout:x86_64 2024-04-10T19:59:44.711 DEBUG:teuthology.orchestra.run.smithi044:> cat /etc/os-release 2024-04-10T19:59:44.766 INFO:teuthology.orchestra.run.smithi044.stdout:NAME="CentOS Stream" 2024-04-10T19:59:44.766 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION="9" 2024-04-10T19:59:44.766 INFO:teuthology.orchestra.run.smithi044.stdout:ID="centos" 2024-04-10T19:59:44.766 INFO:teuthology.orchestra.run.smithi044.stdout:ID_LIKE="rhel fedora" 2024-04-10T19:59:44.766 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION_ID="9" 2024-04-10T19:59:44.766 INFO:teuthology.orchestra.run.smithi044.stdout:PLATFORM_ID="platform:el9" 2024-04-10T19:59:44.767 INFO:teuthology.orchestra.run.smithi044.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-10T19:59:44.767 INFO:teuthology.orchestra.run.smithi044.stdout:ANSI_COLOR="0;31" 2024-04-10T19:59:44.767 INFO:teuthology.orchestra.run.smithi044.stdout:LOGO="fedora-logo-icon" 2024-04-10T19:59:44.767 INFO:teuthology.orchestra.run.smithi044.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-10T19:59:44.767 INFO:teuthology.orchestra.run.smithi044.stdout:HOME_URL="https://centos.org/" 2024-04-10T19:59:44.767 INFO:teuthology.orchestra.run.smithi044.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-10T19:59:44.767 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-10T19:59:44.767 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-10T19:59:44.767 INFO:teuthology.lock.ops:Updating smithi044.front.sepia.ceph.com on lock server 2024-04-10T19:59:44.796 INFO:teuthology.lock.ops:Updating [smithi063.front.sepia.ceph.com]: set os type and version on server 2024-04-10T19:59:44.796 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-04-10T19:59:44.797 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T19:59:44.909 DEBUG:teuthology.orchestra.run.smithi063:> true 2024-04-10T19:59:44.979 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-04-10T19:59:44.979 DEBUG:teuthology.orchestra.run.smithi063:> uname -m 2024-04-10T19:59:45.035 INFO:teuthology.orchestra.run.smithi063.stdout:x86_64 2024-04-10T19:59:45.035 DEBUG:teuthology.orchestra.run.smithi063:> cat /etc/os-release 2024-04-10T19:59:45.091 INFO:teuthology.orchestra.run.smithi063.stdout:NAME="CentOS Stream" 2024-04-10T19:59:45.091 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION="9" 2024-04-10T19:59:45.091 INFO:teuthology.orchestra.run.smithi063.stdout:ID="centos" 2024-04-10T19:59:45.091 INFO:teuthology.orchestra.run.smithi063.stdout:ID_LIKE="rhel fedora" 2024-04-10T19:59:45.091 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION_ID="9" 2024-04-10T19:59:45.091 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM_ID="platform:el9" 2024-04-10T19:59:45.091 INFO:teuthology.orchestra.run.smithi063.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-10T19:59:45.091 INFO:teuthology.orchestra.run.smithi063.stdout:ANSI_COLOR="0;31" 2024-04-10T19:59:45.091 INFO:teuthology.orchestra.run.smithi063.stdout:LOGO="fedora-logo-icon" 2024-04-10T19:59:45.091 INFO:teuthology.orchestra.run.smithi063.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-10T19:59:45.091 INFO:teuthology.orchestra.run.smithi063.stdout:HOME_URL="https://centos.org/" 2024-04-10T19:59:45.092 INFO:teuthology.orchestra.run.smithi063.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-10T19:59:45.092 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-10T19:59:45.092 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-10T19:59:45.092 INFO:teuthology.lock.ops:Updating smithi063.front.sepia.ceph.com on lock server 2024-04-10T19:59:45.129 INFO:teuthology.lock.ops:Updating [smithi069.front.sepia.ceph.com]: set os type and version on server 2024-04-10T19:59:45.129 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi069.front.sepia.ceph.com' 2024-04-10T19:59:45.130 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T19:59:45.227 DEBUG:teuthology.orchestra.run.smithi069:> true 2024-04-10T19:59:45.295 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi069.front.sepia.ceph.com' 2024-04-10T19:59:45.295 DEBUG:teuthology.orchestra.run.smithi069:> uname -m 2024-04-10T19:59:45.351 INFO:teuthology.orchestra.run.smithi069.stdout:x86_64 2024-04-10T19:59:45.351 DEBUG:teuthology.orchestra.run.smithi069:> cat /etc/os-release 2024-04-10T19:59:45.407 INFO:teuthology.orchestra.run.smithi069.stdout:NAME="CentOS Stream" 2024-04-10T19:59:45.407 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION="9" 2024-04-10T19:59:45.407 INFO:teuthology.orchestra.run.smithi069.stdout:ID="centos" 2024-04-10T19:59:45.407 INFO:teuthology.orchestra.run.smithi069.stdout:ID_LIKE="rhel fedora" 2024-04-10T19:59:45.407 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION_ID="9" 2024-04-10T19:59:45.407 INFO:teuthology.orchestra.run.smithi069.stdout:PLATFORM_ID="platform:el9" 2024-04-10T19:59:45.407 INFO:teuthology.orchestra.run.smithi069.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-10T19:59:45.407 INFO:teuthology.orchestra.run.smithi069.stdout:ANSI_COLOR="0;31" 2024-04-10T19:59:45.407 INFO:teuthology.orchestra.run.smithi069.stdout:LOGO="fedora-logo-icon" 2024-04-10T19:59:45.407 INFO:teuthology.orchestra.run.smithi069.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-10T19:59:45.407 INFO:teuthology.orchestra.run.smithi069.stdout:HOME_URL="https://centos.org/" 2024-04-10T19:59:45.407 INFO:teuthology.orchestra.run.smithi069.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-10T19:59:45.408 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-10T19:59:45.408 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-10T19:59:45.408 INFO:teuthology.lock.ops:Updating smithi069.front.sepia.ceph.com on lock server 2024-04-10T19:59:45.438 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-10T19:59:45.571 INFO:teuthology.dispatcher.supervisor:Running job 7651106 2024-04-10T19:59:45.571 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-04-10_14:20:47-rados-wip-yuri10-testing-2024-03-24-1159-distro-default-smithi/7651106 --name yuriw-2024-04-10_14:20:47-rados-wip-yuri10-testing-2024-03-24-1159-distro-default-smithi --description rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} -- /home/teuthworker/archive/yuriw-2024-04-10_14:20:47-rados-wip-yuri10-testing-2024-03-24-1159-distro-default-smithi/7651106/orig.config.yaml 2024-04-10T19:59:45.574 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-04-10_14:20:47-rados-wip-yuri10-testing-2024-03-24-1159-distro-default-smithi/7651106 2024-04-10T19:59:45.574 INFO:teuthology.dispatcher.supervisor:Job PID: 3297232 2024-04-10T19:59:45.574 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-10T20:01:45.676 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-10T20:03:45.863 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-10T20:03:45.948 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1