2024-04-19T01:08:22.446 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-19T01:08:22.447 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-19T01:08:22.632 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f404c98ac10>, signals=[15]) 2024-04-19T01:08:22.633 INFO:teuthology.lock.ops:Start node 'smithi019.front.sepia.ceph.com' reimaging 2024-04-19T01:08:22.633 INFO:teuthology.lock.ops:Updating [smithi019.front.sepia.ceph.com]: reset os type and version on server 2024-04-19T01:08:22.633 INFO:teuthology.lock.ops:Updating smithi019.front.sepia.ceph.com on lock server 2024-04-19T01:08:22.654 INFO:teuthology.lock.ops:Start node 'smithi059.front.sepia.ceph.com' reimaging 2024-04-19T01:08:22.655 INFO:teuthology.lock.ops:Updating [smithi059.front.sepia.ceph.com]: reset os type and version on server 2024-04-19T01:08:22.655 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server 2024-04-19T01:08:22.671 INFO:teuthology.lock.ops:Start node 'smithi184.front.sepia.ceph.com' reimaging 2024-04-19T01:08:22.671 INFO:teuthology.lock.ops:Updating [smithi184.front.sepia.ceph.com]: reset os type and version on server 2024-04-19T01:08:22.671 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server 2024-04-19T01:08:22.782 DEBUG:teuthology.provision.fog.smithi019:Requesting image smithi_centos_9.stream (ID 10) 2024-04-19T01:08:22.788 DEBUG:teuthology.provision.fog.smithi059:Requesting image smithi_centos_9.stream (ID 10) 2024-04-19T01:08:22.806 DEBUG:teuthology.provision.fog.smithi184:Requesting image smithi_centos_9.stream (ID 10) 2024-04-19T01:08:22.825 INFO:teuthology.provision.fog.smithi019:Scheduling deploy of centos 9.stream 2024-04-19T01:08:22.837 INFO:teuthology.provision.fog.smithi059:Scheduling deploy of centos 9.stream 2024-04-19T01:08:22.847 INFO:teuthology.provision.fog.smithi184:Scheduling deploy of centos 9.stream 2024-04-19T01:08:23.222 INFO:teuthology.orchestra.console.smithi019:Power off 2024-04-19T01:08:23.222 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-19T01:08:23.237 INFO:teuthology.orchestra.console.smithi184:Power off 2024-04-19T01:08:23.237 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-19T01:08:23.250 INFO:teuthology.orchestra.console.smithi059:Power off 2024-04-19T01:08:23.251 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-19T01:08:23.260 DEBUG:teuthology.orchestra.console.smithi184:power off output: Chassis Power Control: Down/Off 2024-04-19T01:08:23.260 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T01:08:23.268 DEBUG:teuthology.orchestra.console.smithi019:power off output: Chassis Power Control: Down/Off 2024-04-19T01:08:23.268 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T01:08:23.277 DEBUG:teuthology.orchestra.console.smithi059:power off output: Chassis Power Control: Down/Off 2024-04-19T01:08:23.278 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T01:08:23.287 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is off 2024-04-19T01:08:23.293 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is off 2024-04-19T01:08:23.298 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off 2024-04-19T01:08:23.389 INFO:teuthology.orchestra.console.smithi184:Power off completed 2024-04-19T01:08:23.394 INFO:teuthology.orchestra.console.smithi019:Power off completed 2024-04-19T01:08:23.401 INFO:teuthology.orchestra.console.smithi059:Power off completed 2024-04-19T01:08:23.490 INFO:teuthology.orchestra.console.smithi184:Power on 2024-04-19T01:08:23.490 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-19T01:08:23.498 INFO:teuthology.orchestra.console.smithi019:Power on 2024-04-19T01:08:23.498 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-19T01:08:23.505 INFO:teuthology.orchestra.console.smithi059:Power on 2024-04-19T01:08:23.505 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-19T01:08:23.515 DEBUG:teuthology.orchestra.console.smithi184:power on output: Chassis Power Control: Up/On 2024-04-19T01:08:23.516 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T01:08:23.525 DEBUG:teuthology.orchestra.console.smithi019:power on output: Chassis Power Control: Up/On 2024-04-19T01:08:23.526 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T01:08:23.535 DEBUG:teuthology.orchestra.console.smithi059:power on output: Chassis Power Control: Up/On 2024-04-19T01:08:23.535 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T01:08:23.544 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is off 2024-04-19T01:08:23.548 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is off 2024-04-19T01:08:23.558 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off 2024-04-19T01:08:27.546 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T01:08:27.553 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T01:08:27.559 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T01:08:27.656 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is on 2024-04-19T01:08:27.661 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is off 2024-04-19T01:08:27.667 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off 2024-04-19T01:08:27.757 INFO:teuthology.orchestra.console.smithi184:Power on completed 2024-04-19T01:08:27.858 INFO:teuthology.provision.fog.smithi184:Waiting for deploy to finish 2024-04-19T01:08:31.662 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T01:08:31.670 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T01:08:31.772 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is on 2024-04-19T01:08:31.779 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2024-04-19T01:08:31.874 INFO:teuthology.orchestra.console.smithi019:Power on completed 2024-04-19T01:08:31.880 INFO:teuthology.orchestra.console.smithi059:Power on completed 2024-04-19T01:08:31.975 INFO:teuthology.provision.fog.smithi019:Waiting for deploy to finish 2024-04-19T01:08:31.981 INFO:teuthology.provision.fog.smithi059:Waiting for deploy to finish 2024-04-19T01:11:03.949 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T01:11:03.957 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T01:11:07.010 WARNING:teuthology.provision.fog.smithi019:[Errno None] Unable to connect to port 22 on 172.21.15.19 2024-04-19T01:11:07.038 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59 2024-04-19T01:11:13.015 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T01:11:13.040 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T01:11:15.118 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T01:11:16.094 WARNING:teuthology.provision.fog.smithi019:[Errno None] Unable to connect to port 22 on 172.21.15.19 2024-04-19T01:11:16.095 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59 2024-04-19T01:11:18.174 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2024-04-19T01:11:22.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T01:11:22.101 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T01:11:24.178 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T01:11:25.150 WARNING:teuthology.provision.fog.smithi019:[Errno None] Unable to connect to port 22 on 172.21.15.19 2024-04-19T01:11:25.182 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59 2024-04-19T01:11:27.230 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2024-04-19T01:11:31.155 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T01:11:31.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T01:11:33.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T01:11:34.206 WARNING:teuthology.provision.fog.smithi019:[Errno None] Unable to connect to port 22 on 172.21.15.19 2024-04-19T01:11:34.238 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59 2024-04-19T01:11:36.286 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2024-04-19T01:11:40.212 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T01:11:40.239 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T01:11:42.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T01:11:43.262 WARNING:teuthology.provision.fog.smithi019:[Errno None] Unable to connect to port 22 on 172.21.15.19 2024-04-19T01:11:43.294 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59 2024-04-19T01:11:45.346 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2024-04-19T01:11:49.268 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T01:11:49.295 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T01:11:51.350 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T01:11:52.322 WARNING:teuthology.provision.fog.smithi019:[Errno None] Unable to connect to port 22 on 172.21.15.19 2024-04-19T01:11:54.431 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2024-04-19T01:11:58.326 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T01:12:00.435 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T01:12:03.490 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2024-04-19T01:12:09.497 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T01:12:49.335 WARNING:teuthology.provision.fog.smithi059:timed out 2024-04-19T01:12:55.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T01:12:55.614 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-19T01:12:55.615 DEBUG:teuthology.orchestra.run.smithi059:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-19T01:12:55.947 INFO:teuthology.provision.fog.smithi059:Node is ready 2024-04-19T01:12:55.947 DEBUG:teuthology.orchestra.run.smithi059:> hostname 2024-04-19T01:12:55.962 INFO:teuthology.orchestra.run.smithi059.stdout:smithi059.front.sepia.ceph.com 2024-04-19T01:12:55.962 DEBUG:teuthology.orchestra.run.smithi059:> grep smithi059.front.sepia.ceph.com /etc/hosts 2024-04-19T01:12:56.017 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59 smithi059.front.sepia.ceph.com smithi059 2024-04-19T01:12:56.017 DEBUG:teuthology.orchestra.run.smithi059:> sudo hostname smithi059 2024-04-19T01:12:56.126 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/smithi059.front.sepia.ceph.com/smithi059/g' /etc/hosts 2024-04-19T01:12:56.158 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/172.21.15.59/172.21.15.59/g' /etc/hosts 2024-04-19T01:12:56.229 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/smithi059.front.sepia.ceph.com/smithi059/g' /etc/hostname 2024-04-19T01:12:56.300 DEBUG:teuthology.orchestra.run.smithi059:> sudo hostname smithi059 2024-04-19T01:12:56.370 DEBUG:teuthology.orchestra.run.smithi059:> cat /etc/os-release 2024-04-19T01:12:56.426 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="CentOS Stream" 2024-04-19T01:12:56.426 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="9" 2024-04-19T01:12:56.426 INFO:teuthology.orchestra.run.smithi059.stdout:ID="centos" 2024-04-19T01:12:56.426 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE="rhel fedora" 2024-04-19T01:12:56.426 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="9" 2024-04-19T01:12:56.426 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM_ID="platform:el9" 2024-04-19T01:12:56.426 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-19T01:12:56.426 INFO:teuthology.orchestra.run.smithi059.stdout:ANSI_COLOR="0;31" 2024-04-19T01:12:56.426 INFO:teuthology.orchestra.run.smithi059.stdout:LOGO="fedora-logo-icon" 2024-04-19T01:12:56.426 INFO:teuthology.orchestra.run.smithi059.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-19T01:12:56.426 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://centos.org/" 2024-04-19T01:12:56.426 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-19T01:12:56.426 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-19T01:12:56.427 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-19T01:12:56.427 INFO:teuthology.provision.fog.smithi059:Deploy complete! 2024-04-19T01:12:56.429 DEBUG:teuthology.parallel:result is None 2024-04-19T01:12:58.331 WARNING:teuthology.provision.fog.smithi019:timed out 2024-04-19T01:13:04.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T01:13:04.618 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-19T01:13:04.618 DEBUG:teuthology.orchestra.run.smithi019:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-19T01:13:04.950 INFO:teuthology.provision.fog.smithi019:Node is ready 2024-04-19T01:13:04.950 DEBUG:teuthology.orchestra.run.smithi019:> hostname 2024-04-19T01:13:04.965 INFO:teuthology.orchestra.run.smithi019.stdout:smithi019.front.sepia.ceph.com 2024-04-19T01:13:04.965 DEBUG:teuthology.orchestra.run.smithi019:> grep smithi019.front.sepia.ceph.com /etc/hosts 2024-04-19T01:13:05.021 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19 smithi019.front.sepia.ceph.com smithi019 2024-04-19T01:13:05.021 DEBUG:teuthology.orchestra.run.smithi019:> sudo hostname smithi019 2024-04-19T01:13:05.195 DEBUG:teuthology.orchestra.run.smithi019:> sudo sed -i -e 's/smithi019.front.sepia.ceph.com/smithi019/g' /etc/hosts 2024-04-19T01:13:05.227 DEBUG:teuthology.orchestra.run.smithi019:> sudo sed -i -e 's/172.21.15.19/172.21.15.19/g' /etc/hosts 2024-04-19T01:13:05.298 DEBUG:teuthology.orchestra.run.smithi019:> sudo sed -i -e 's/smithi019.front.sepia.ceph.com/smithi019/g' /etc/hostname 2024-04-19T01:13:05.368 DEBUG:teuthology.orchestra.run.smithi019:> sudo hostname smithi019 2024-04-19T01:13:05.439 DEBUG:teuthology.orchestra.run.smithi019:> cat /etc/os-release 2024-04-19T01:13:05.494 INFO:teuthology.orchestra.run.smithi019.stdout:NAME="CentOS Stream" 2024-04-19T01:13:05.494 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION="9" 2024-04-19T01:13:05.494 INFO:teuthology.orchestra.run.smithi019.stdout:ID="centos" 2024-04-19T01:13:05.494 INFO:teuthology.orchestra.run.smithi019.stdout:ID_LIKE="rhel fedora" 2024-04-19T01:13:05.494 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION_ID="9" 2024-04-19T01:13:05.494 INFO:teuthology.orchestra.run.smithi019.stdout:PLATFORM_ID="platform:el9" 2024-04-19T01:13:05.495 INFO:teuthology.orchestra.run.smithi019.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-19T01:13:05.495 INFO:teuthology.orchestra.run.smithi019.stdout:ANSI_COLOR="0;31" 2024-04-19T01:13:05.495 INFO:teuthology.orchestra.run.smithi019.stdout:LOGO="fedora-logo-icon" 2024-04-19T01:13:05.495 INFO:teuthology.orchestra.run.smithi019.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-19T01:13:05.495 INFO:teuthology.orchestra.run.smithi019.stdout:HOME_URL="https://centos.org/" 2024-04-19T01:13:05.495 INFO:teuthology.orchestra.run.smithi019.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-19T01:13:05.495 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-19T01:13:05.495 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-19T01:13:05.495 INFO:teuthology.provision.fog.smithi019:Deploy complete! 2024-04-19T01:13:05.496 DEBUG:teuthology.parallel:result is None 2024-04-19T01:13:09.502 WARNING:teuthology.provision.fog.smithi184:timed out 2024-04-19T01:13:15.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T01:13:15.907 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-19T01:13:15.907 DEBUG:teuthology.orchestra.run.smithi184:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-19T01:13:16.233 INFO:teuthology.provision.fog.smithi184:Node is ready 2024-04-19T01:13:16.234 DEBUG:teuthology.orchestra.run.smithi184:> hostname 2024-04-19T01:13:16.248 INFO:teuthology.orchestra.run.smithi184.stdout:smithi184.front.sepia.ceph.com 2024-04-19T01:13:16.248 DEBUG:teuthology.orchestra.run.smithi184:> grep smithi184.front.sepia.ceph.com /etc/hosts 2024-04-19T01:13:16.303 INFO:teuthology.orchestra.run.smithi184.stdout:172.21.15.184 smithi184.front.sepia.ceph.com smithi184 2024-04-19T01:13:16.303 DEBUG:teuthology.orchestra.run.smithi184:> sudo hostname smithi184 2024-04-19T01:13:16.423 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i -e 's/smithi184.front.sepia.ceph.com/smithi184/g' /etc/hosts 2024-04-19T01:13:16.451 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i -e 's/172.21.15.184/172.21.15.184/g' /etc/hosts 2024-04-19T01:13:16.522 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i -e 's/smithi184.front.sepia.ceph.com/smithi184/g' /etc/hostname 2024-04-19T01:13:16.592 DEBUG:teuthology.orchestra.run.smithi184:> sudo hostname smithi184 2024-04-19T01:13:16.662 DEBUG:teuthology.orchestra.run.smithi184:> cat /etc/os-release 2024-04-19T01:13:16.722 INFO:teuthology.orchestra.run.smithi184.stdout:NAME="CentOS Stream" 2024-04-19T01:13:16.722 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION="9" 2024-04-19T01:13:16.722 INFO:teuthology.orchestra.run.smithi184.stdout:ID="centos" 2024-04-19T01:13:16.722 INFO:teuthology.orchestra.run.smithi184.stdout:ID_LIKE="rhel fedora" 2024-04-19T01:13:16.723 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_ID="9" 2024-04-19T01:13:16.723 INFO:teuthology.orchestra.run.smithi184.stdout:PLATFORM_ID="platform:el9" 2024-04-19T01:13:16.723 INFO:teuthology.orchestra.run.smithi184.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-19T01:13:16.723 INFO:teuthology.orchestra.run.smithi184.stdout:ANSI_COLOR="0;31" 2024-04-19T01:13:16.723 INFO:teuthology.orchestra.run.smithi184.stdout:LOGO="fedora-logo-icon" 2024-04-19T01:13:16.723 INFO:teuthology.orchestra.run.smithi184.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-19T01:13:16.723 INFO:teuthology.orchestra.run.smithi184.stdout:HOME_URL="https://centos.org/" 2024-04-19T01:13:16.723 INFO:teuthology.orchestra.run.smithi184.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-19T01:13:16.723 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-19T01:13:16.723 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-19T01:13:16.723 INFO:teuthology.provision.fog.smithi184:Deploy complete! 2024-04-19T01:13:16.724 DEBUG:teuthology.parallel:result is None 2024-04-19T01:13:16.944 INFO:teuthology.lock.ops:Checking smithi019.front.sepia.ceph.com 2024-04-19T01:13:16.945 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-19T01:13:16.967 INFO:teuthology.lock.ops:Checking smithi059.front.sepia.ceph.com 2024-04-19T01:13:16.967 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-19T01:13:16.983 INFO:teuthology.lock.ops:Checking smithi184.front.sepia.ceph.com 2024-04-19T01:13:16.983 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-19T01:13:17.001 INFO:teuthology.lock.ops:Updating [smithi019.front.sepia.ceph.com]: set os type and version on server 2024-04-19T01:13:17.001 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-04-19T01:13:17.001 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T01:13:17.105 DEBUG:teuthology.orchestra.run.smithi019:> true 2024-04-19T01:13:17.289 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-04-19T01:13:17.289 DEBUG:teuthology.orchestra.run.smithi019:> uname -m 2024-04-19T01:13:17.344 INFO:teuthology.orchestra.run.smithi019.stdout:x86_64 2024-04-19T01:13:17.344 DEBUG:teuthology.orchestra.run.smithi019:> cat /etc/os-release 2024-04-19T01:13:17.399 INFO:teuthology.orchestra.run.smithi019.stdout:NAME="CentOS Stream" 2024-04-19T01:13:17.399 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION="9" 2024-04-19T01:13:17.399 INFO:teuthology.orchestra.run.smithi019.stdout:ID="centos" 2024-04-19T01:13:17.399 INFO:teuthology.orchestra.run.smithi019.stdout:ID_LIKE="rhel fedora" 2024-04-19T01:13:17.399 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION_ID="9" 2024-04-19T01:13:17.399 INFO:teuthology.orchestra.run.smithi019.stdout:PLATFORM_ID="platform:el9" 2024-04-19T01:13:17.399 INFO:teuthology.orchestra.run.smithi019.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-19T01:13:17.400 INFO:teuthology.orchestra.run.smithi019.stdout:ANSI_COLOR="0;31" 2024-04-19T01:13:17.400 INFO:teuthology.orchestra.run.smithi019.stdout:LOGO="fedora-logo-icon" 2024-04-19T01:13:17.400 INFO:teuthology.orchestra.run.smithi019.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-19T01:13:17.400 INFO:teuthology.orchestra.run.smithi019.stdout:HOME_URL="https://centos.org/" 2024-04-19T01:13:17.400 INFO:teuthology.orchestra.run.smithi019.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-19T01:13:17.400 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-19T01:13:17.400 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-19T01:13:17.400 INFO:teuthology.lock.ops:Updating smithi019.front.sepia.ceph.com on lock server 2024-04-19T01:13:17.425 INFO:teuthology.lock.ops:Updating [smithi059.front.sepia.ceph.com]: set os type and version on server 2024-04-19T01:13:17.425 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-04-19T01:13:17.426 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T01:13:17.529 DEBUG:teuthology.orchestra.run.smithi059:> true 2024-04-19T01:13:17.708 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-04-19T01:13:17.708 DEBUG:teuthology.orchestra.run.smithi059:> uname -m 2024-04-19T01:13:17.763 INFO:teuthology.orchestra.run.smithi059.stdout:x86_64 2024-04-19T01:13:17.763 DEBUG:teuthology.orchestra.run.smithi059:> cat /etc/os-release 2024-04-19T01:13:17.818 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="CentOS Stream" 2024-04-19T01:13:17.818 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="9" 2024-04-19T01:13:17.818 INFO:teuthology.orchestra.run.smithi059.stdout:ID="centos" 2024-04-19T01:13:17.818 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE="rhel fedora" 2024-04-19T01:13:17.818 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="9" 2024-04-19T01:13:17.818 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM_ID="platform:el9" 2024-04-19T01:13:17.818 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-19T01:13:17.818 INFO:teuthology.orchestra.run.smithi059.stdout:ANSI_COLOR="0;31" 2024-04-19T01:13:17.818 INFO:teuthology.orchestra.run.smithi059.stdout:LOGO="fedora-logo-icon" 2024-04-19T01:13:17.818 INFO:teuthology.orchestra.run.smithi059.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-19T01:13:17.819 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://centos.org/" 2024-04-19T01:13:17.819 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-19T01:13:17.819 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-19T01:13:17.819 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-19T01:13:17.819 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server 2024-04-19T01:13:17.841 INFO:teuthology.lock.ops:Updating [smithi184.front.sepia.ceph.com]: set os type and version on server 2024-04-19T01:13:17.841 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-04-19T01:13:17.842 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T01:13:17.928 DEBUG:teuthology.orchestra.run.smithi184:> true 2024-04-19T01:13:17.998 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-04-19T01:13:17.998 DEBUG:teuthology.orchestra.run.smithi184:> uname -m 2024-04-19T01:13:18.057 INFO:teuthology.orchestra.run.smithi184.stdout:x86_64 2024-04-19T01:13:18.057 DEBUG:teuthology.orchestra.run.smithi184:> cat /etc/os-release 2024-04-19T01:13:18.115 INFO:teuthology.orchestra.run.smithi184.stdout:NAME="CentOS Stream" 2024-04-19T01:13:18.115 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION="9" 2024-04-19T01:13:18.115 INFO:teuthology.orchestra.run.smithi184.stdout:ID="centos" 2024-04-19T01:13:18.115 INFO:teuthology.orchestra.run.smithi184.stdout:ID_LIKE="rhel fedora" 2024-04-19T01:13:18.115 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_ID="9" 2024-04-19T01:13:18.115 INFO:teuthology.orchestra.run.smithi184.stdout:PLATFORM_ID="platform:el9" 2024-04-19T01:13:18.115 INFO:teuthology.orchestra.run.smithi184.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-19T01:13:18.115 INFO:teuthology.orchestra.run.smithi184.stdout:ANSI_COLOR="0;31" 2024-04-19T01:13:18.116 INFO:teuthology.orchestra.run.smithi184.stdout:LOGO="fedora-logo-icon" 2024-04-19T01:13:18.116 INFO:teuthology.orchestra.run.smithi184.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-19T01:13:18.116 INFO:teuthology.orchestra.run.smithi184.stdout:HOME_URL="https://centos.org/" 2024-04-19T01:13:18.116 INFO:teuthology.orchestra.run.smithi184.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-19T01:13:18.116 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-19T01:13:18.116 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-19T01:13:18.116 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server 2024-04-19T01:13:18.142 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-19T01:13:18.241 INFO:teuthology.dispatcher.supervisor:Running job 7663278 2024-04-19T01:13:18.241 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-04-18_22:49:05-rados-wip-yuri5-testing-2024-04-17-1400-distro-default-smithi/7663278 --name yuriw-2024-04-18_22:49:05-rados-wip-yuri5-testing-2024-04-17-1400-distro-default-smithi --description rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} -- /home/teuthworker/archive/yuriw-2024-04-18_22:49:05-rados-wip-yuri5-testing-2024-04-17-1400-distro-default-smithi/7663278/orig.config.yaml 2024-04-19T01:13:18.244 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-04-18_22:49:05-rados-wip-yuri5-testing-2024-04-17-1400-distro-default-smithi/7663278 2024-04-19T01:13:18.244 INFO:teuthology.dispatcher.supervisor:Job PID: 2858674 2024-04-19T01:13:18.244 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-19T01:15:18.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-19T01:17:18.522 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-19T01:19:18.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-19T01:21:18.867 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-19T01:21:18.948 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1