2024-03-11T09:06:15.308 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-11T09:06:15.309 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T09:06:15.482 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7c70bfec10>, signals=[15]) 2024-03-11T09:06:15.482 INFO:teuthology.lock.ops:Start node 'smithi012.front.sepia.ceph.com' reimaging 2024-03-11T09:06:15.483 INFO:teuthology.lock.ops:Updating [smithi012.front.sepia.ceph.com]: reset os type and version on server 2024-03-11T09:06:15.483 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server 2024-03-11T09:06:15.512 INFO:teuthology.lock.ops:Start node 'smithi100.front.sepia.ceph.com' reimaging 2024-03-11T09:06:15.512 INFO:teuthology.lock.ops:Updating [smithi100.front.sepia.ceph.com]: reset os type and version on server 2024-03-11T09:06:15.512 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server 2024-03-11T09:06:15.534 INFO:teuthology.lock.ops:Start node 'smithi170.front.sepia.ceph.com' reimaging 2024-03-11T09:06:15.534 INFO:teuthology.lock.ops:Updating [smithi170.front.sepia.ceph.com]: reset os type and version on server 2024-03-11T09:06:15.534 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server 2024-03-11T09:06:15.640 DEBUG:teuthology.provision.fog.smithi012:Requesting image smithi_centos_9.stream (ID 10) 2024-03-11T09:06:15.645 DEBUG:teuthology.provision.fog.smithi100:Requesting image smithi_centos_9.stream (ID 10) 2024-03-11T09:06:15.662 DEBUG:teuthology.provision.fog.smithi170:Requesting image smithi_centos_9.stream (ID 10) 2024-03-11T09:06:15.694 INFO:teuthology.provision.fog.smithi012:Scheduling deploy of centos 9.stream 2024-03-11T09:06:15.697 INFO:teuthology.provision.fog.smithi100:Scheduling deploy of centos 9.stream 2024-03-11T09:06:15.711 INFO:teuthology.provision.fog.smithi170:Scheduling deploy of centos 9.stream 2024-03-11T09:06:16.107 INFO:teuthology.orchestra.console.smithi100:Power off 2024-03-11T09:06:16.107 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-11T09:06:16.130 DEBUG:teuthology.orchestra.console.smithi100:power off output: Chassis Power Control: Down/Off 2024-03-11T09:06:16.131 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T09:06:16.144 INFO:teuthology.orchestra.console.smithi170:Power off 2024-03-11T09:06:16.144 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-11T09:06:16.158 INFO:teuthology.orchestra.console.smithi012:Power off 2024-03-11T09:06:16.158 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-11T09:06:16.164 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is off 2024-03-11T09:06:16.166 DEBUG:teuthology.orchestra.console.smithi170:power off output: Chassis Power Control: Down/Off 2024-03-11T09:06:16.166 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T09:06:16.179 DEBUG:teuthology.orchestra.console.smithi012:power off output: Chassis Power Control: Down/Off 2024-03-11T09:06:16.179 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T09:06:16.189 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is off 2024-03-11T09:06:16.202 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on 2024-03-11T09:06:16.265 INFO:teuthology.orchestra.console.smithi100:Power off completed 2024-03-11T09:06:16.290 INFO:teuthology.orchestra.console.smithi170:Power off completed 2024-03-11T09:06:16.366 INFO:teuthology.orchestra.console.smithi100:Power on 2024-03-11T09:06:16.367 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-11T09:06:16.388 DEBUG:teuthology.orchestra.console.smithi100:power on output: Chassis Power Control: Up/On 2024-03-11T09:06:16.389 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T09:06:16.397 INFO:teuthology.orchestra.console.smithi170:Power on 2024-03-11T09:06:16.397 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-11T09:06:16.411 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is off 2024-03-11T09:06:16.420 DEBUG:teuthology.orchestra.console.smithi170:power on output: Chassis Power Control: Up/On 2024-03-11T09:06:16.420 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T09:06:16.443 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is off 2024-03-11T09:06:20.206 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T09:06:20.315 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on 2024-03-11T09:06:20.413 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T09:06:20.444 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T09:06:20.522 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is off 2024-03-11T09:06:20.552 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is off 2024-03-11T09:06:24.318 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T09:06:24.427 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is off 2024-03-11T09:06:24.523 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T09:06:24.530 INFO:teuthology.orchestra.console.smithi012:Power off completed 2024-03-11T09:06:24.553 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T09:06:24.631 INFO:teuthology.orchestra.console.smithi012:Power on 2024-03-11T09:06:24.632 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-11T09:06:24.657 DEBUG:teuthology.orchestra.console.smithi012:power on output: Chassis Power Control: Up/On 2024-03-11T09:06:24.657 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T09:06:24.857 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on 2024-03-11T09:06:24.857 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is on 2024-03-11T09:06:24.873 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is off 2024-03-11T09:06:24.958 INFO:teuthology.orchestra.console.smithi100:Power on completed 2024-03-11T09:06:24.958 INFO:teuthology.orchestra.console.smithi170:Power on completed 2024-03-11T09:06:25.059 INFO:teuthology.provision.fog.smithi100:Waiting for deploy to finish 2024-03-11T09:06:25.061 INFO:teuthology.provision.fog.smithi170:Waiting for deploy to finish 2024-03-11T09:06:28.874 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T09:06:28.982 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is off 2024-03-11T09:06:32.986 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T09:06:33.095 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on 2024-03-11T09:06:33.196 INFO:teuthology.orchestra.console.smithi012:Power on completed 2024-03-11T09:06:33.297 INFO:teuthology.provision.fog.smithi012:Waiting for deploy to finish 2024-03-11T09:09:28.849 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T09:09:31.902 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100 2024-03-11T09:09:37.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T09:09:40.958 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100 2024-03-11T09:09:46.961 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T09:09:50.014 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100 2024-03-11T09:09:56.019 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T09:09:59.070 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100 2024-03-11T09:10:05.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T09:10:08.158 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100 2024-03-11T09:10:14.165 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T09:10:22.173 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T09:10:25.246 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2024-03-11T09:10:31.250 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T09:10:34.302 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2024-03-11T09:10:40.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T09:10:43.358 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2024-03-11T09:10:49.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T09:10:52.418 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2024-03-11T09:10:58.423 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T09:11:01.502 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2024-03-11T09:11:07.506 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T09:11:14.174 WARNING:teuthology.provision.fog.smithi100:timed out 2024-03-11T09:11:20.179 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T09:11:20.410 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-11T09:11:20.411 DEBUG:teuthology.orchestra.run.smithi100:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-11T09:11:20.756 INFO:teuthology.provision.fog.smithi100:Node is ready 2024-03-11T09:11:20.757 DEBUG:teuthology.orchestra.run.smithi100:> hostname 2024-03-11T09:11:20.771 INFO:teuthology.orchestra.run.smithi100.stdout:smithi100.front.sepia.ceph.com 2024-03-11T09:11:20.772 DEBUG:teuthology.orchestra.run.smithi100:> grep smithi100.front.sepia.ceph.com /etc/hosts 2024-03-11T09:11:20.827 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100 smithi100.front.sepia.ceph.com smithi100 2024-03-11T09:11:20.828 DEBUG:teuthology.orchestra.run.smithi100:> sudo hostname smithi100 2024-03-11T09:11:20.938 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i -e 's/smithi100.front.sepia.ceph.com/smithi100/g' /etc/hosts 2024-03-11T09:11:20.966 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i -e 's/172.21.15.100/172.21.15.100/g' /etc/hosts 2024-03-11T09:11:21.034 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i -e 's/smithi100.front.sepia.ceph.com/smithi100/g' /etc/hostname 2024-03-11T09:11:21.101 DEBUG:teuthology.orchestra.run.smithi100:> sudo hostname smithi100 2024-03-11T09:11:21.168 DEBUG:teuthology.orchestra.run.smithi100:> cat /etc/os-release 2024-03-11T09:11:21.222 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="CentOS Stream" 2024-03-11T09:11:21.222 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="9" 2024-03-11T09:11:21.222 INFO:teuthology.orchestra.run.smithi100.stdout:ID="centos" 2024-03-11T09:11:21.222 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE="rhel fedora" 2024-03-11T09:11:21.222 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="9" 2024-03-11T09:11:21.222 INFO:teuthology.orchestra.run.smithi100.stdout:PLATFORM_ID="platform:el9" 2024-03-11T09:11:21.223 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-11T09:11:21.223 INFO:teuthology.orchestra.run.smithi100.stdout:ANSI_COLOR="0;31" 2024-03-11T09:11:21.223 INFO:teuthology.orchestra.run.smithi100.stdout:LOGO="fedora-logo-icon" 2024-03-11T09:11:21.223 INFO:teuthology.orchestra.run.smithi100.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-11T09:11:21.223 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://centos.org/" 2024-03-11T09:11:21.223 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-11T09:11:21.223 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-11T09:11:21.223 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-11T09:11:21.224 INFO:teuthology.provision.fog.smithi100:Deploy complete! 2024-03-11T09:11:21.225 DEBUG:teuthology.parallel:result is None 2024-03-11T09:12:07.516 WARNING:teuthology.provision.fog.smithi012:timed out 2024-03-11T09:12:13.523 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T09:12:13.780 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-11T09:12:13.780 DEBUG:teuthology.orchestra.run.smithi012:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-11T09:12:14.144 INFO:teuthology.provision.fog.smithi012:Node is ready 2024-03-11T09:12:14.144 DEBUG:teuthology.orchestra.run.smithi012:> hostname 2024-03-11T09:12:14.159 INFO:teuthology.orchestra.run.smithi012.stdout:smithi012.front.sepia.ceph.com 2024-03-11T09:12:14.159 DEBUG:teuthology.orchestra.run.smithi012:> grep smithi012.front.sepia.ceph.com /etc/hosts 2024-03-11T09:12:14.214 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12 smithi012.front.sepia.ceph.com smithi012 2024-03-11T09:12:14.214 DEBUG:teuthology.orchestra.run.smithi012:> sudo hostname smithi012 2024-03-11T09:12:14.319 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i -e 's/smithi012.front.sepia.ceph.com/smithi012/g' /etc/hosts 2024-03-11T09:12:14.350 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i -e 's/172.21.15.12/172.21.15.12/g' /etc/hosts 2024-03-11T09:12:14.422 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i -e 's/smithi012.front.sepia.ceph.com/smithi012/g' /etc/hostname 2024-03-11T09:12:14.493 DEBUG:teuthology.orchestra.run.smithi012:> sudo hostname smithi012 2024-03-11T09:12:14.563 DEBUG:teuthology.orchestra.run.smithi012:> cat /etc/os-release 2024-03-11T09:12:14.618 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="CentOS Stream" 2024-03-11T09:12:14.618 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="9" 2024-03-11T09:12:14.618 INFO:teuthology.orchestra.run.smithi012.stdout:ID="centos" 2024-03-11T09:12:14.618 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE="rhel fedora" 2024-03-11T09:12:14.618 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="9" 2024-03-11T09:12:14.618 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM_ID="platform:el9" 2024-03-11T09:12:14.618 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-11T09:12:14.618 INFO:teuthology.orchestra.run.smithi012.stdout:ANSI_COLOR="0;31" 2024-03-11T09:12:14.618 INFO:teuthology.orchestra.run.smithi012.stdout:LOGO="fedora-logo-icon" 2024-03-11T09:12:14.618 INFO:teuthology.orchestra.run.smithi012.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-11T09:12:14.618 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://centos.org/" 2024-03-11T09:12:14.619 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-11T09:12:14.619 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-11T09:12:14.619 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-11T09:12:14.619 INFO:teuthology.provision.fog.smithi012:Deploy complete! 2024-03-11T09:12:14.620 DEBUG:teuthology.parallel:result is None 2024-03-11T09:13:16.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T09:13:19.422 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2024-03-11T09:13:25.426 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T09:13:28.478 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2024-03-11T09:13:34.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T09:13:37.534 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2024-03-11T09:13:43.542 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T09:13:46.622 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2024-03-11T09:13:52.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T09:13:55.678 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2024-03-11T09:14:01.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T09:14:04.734 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2024-03-11T09:14:10.741 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T09:14:29.278 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2024-03-11T09:14:35.283 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T09:14:38.338 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2024-03-11T09:14:44.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T09:14:47.426 WARNING:teuthology.provision.fog.smithi170:[Errno None] Unable to connect to port 22 on 172.21.15.170 2024-03-11T09:14:53.429 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T09:14:53.819 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-11T09:14:53.819 DEBUG:teuthology.orchestra.run.smithi170:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-11T09:15:09.194 INFO:teuthology.provision.fog.smithi170:Node is ready 2024-03-11T09:15:09.195 DEBUG:teuthology.orchestra.run.smithi170:> hostname 2024-03-11T09:15:09.253 INFO:teuthology.orchestra.run.smithi170.stdout:smithi046 2024-03-11T09:15:09.254 DEBUG:teuthology.orchestra.run.smithi170:> grep smithi046 /etc/hosts 2024-03-11T09:15:09.312 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2024-03-11T09:15:09.312 DEBUG:teuthology.orchestra.run.smithi170:> sudo hostname smithi170 2024-03-11T09:15:09.470 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i -e 's/smithi046/smithi170/g' /etc/hosts 2024-03-11T09:15:09.501 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i -e 's/172.21.15.46/172.21.15.170/g' /etc/hosts 2024-03-11T09:15:09.572 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i -e 's/smithi046/smithi170/g' /etc/hostname 2024-03-11T09:15:09.643 DEBUG:teuthology.orchestra.run.smithi170:> sudo hostname smithi170 2024-03-11T09:15:09.712 DEBUG:teuthology.orchestra.run.smithi170:> cat /etc/os-release 2024-03-11T09:15:09.768 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="CentOS Stream" 2024-03-11T09:15:09.768 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="9" 2024-03-11T09:15:09.768 INFO:teuthology.orchestra.run.smithi170.stdout:ID="centos" 2024-03-11T09:15:09.768 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE="rhel fedora" 2024-03-11T09:15:09.768 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="9" 2024-03-11T09:15:09.768 INFO:teuthology.orchestra.run.smithi170.stdout:PLATFORM_ID="platform:el9" 2024-03-11T09:15:09.768 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-11T09:15:09.768 INFO:teuthology.orchestra.run.smithi170.stdout:ANSI_COLOR="0;31" 2024-03-11T09:15:09.769 INFO:teuthology.orchestra.run.smithi170.stdout:LOGO="fedora-logo-icon" 2024-03-11T09:15:09.769 INFO:teuthology.orchestra.run.smithi170.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-11T09:15:09.769 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://centos.org/" 2024-03-11T09:15:09.769 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-11T09:15:09.769 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-11T09:15:09.769 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-11T09:15:09.769 INFO:teuthology.provision.fog.smithi170:Deploy complete! 2024-03-11T09:15:09.769 DEBUG:teuthology.parallel:result is None 2024-03-11T09:15:09.990 INFO:teuthology.lock.ops:Checking smithi012.front.sepia.ceph.com 2024-03-11T09:15:09.990 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-11T09:15:10.018 INFO:teuthology.lock.ops:Checking smithi100.front.sepia.ceph.com 2024-03-11T09:15:10.018 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-11T09:15:10.034 INFO:teuthology.lock.ops:Checking smithi170.front.sepia.ceph.com 2024-03-11T09:15:10.034 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-11T09:15:10.052 INFO:teuthology.lock.ops:Updating [smithi012.front.sepia.ceph.com]: set os type and version on server 2024-03-11T09:15:10.052 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-03-11T09:15:10.053 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T09:15:10.157 DEBUG:teuthology.orchestra.run.smithi012:> true 2024-03-11T09:15:10.340 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-03-11T09:15:10.340 DEBUG:teuthology.orchestra.run.smithi012:> uname -m 2024-03-11T09:15:10.395 INFO:teuthology.orchestra.run.smithi012.stdout:x86_64 2024-03-11T09:15:10.395 DEBUG:teuthology.orchestra.run.smithi012:> cat /etc/os-release 2024-03-11T09:15:10.450 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="CentOS Stream" 2024-03-11T09:15:10.450 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="9" 2024-03-11T09:15:10.450 INFO:teuthology.orchestra.run.smithi012.stdout:ID="centos" 2024-03-11T09:15:10.450 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE="rhel fedora" 2024-03-11T09:15:10.450 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="9" 2024-03-11T09:15:10.450 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM_ID="platform:el9" 2024-03-11T09:15:10.450 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-11T09:15:10.450 INFO:teuthology.orchestra.run.smithi012.stdout:ANSI_COLOR="0;31" 2024-03-11T09:15:10.451 INFO:teuthology.orchestra.run.smithi012.stdout:LOGO="fedora-logo-icon" 2024-03-11T09:15:10.451 INFO:teuthology.orchestra.run.smithi012.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-11T09:15:10.451 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://centos.org/" 2024-03-11T09:15:10.451 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-11T09:15:10.451 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-11T09:15:10.451 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-11T09:15:10.453 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server 2024-03-11T09:15:10.476 INFO:teuthology.lock.ops:Updating [smithi100.front.sepia.ceph.com]: set os type and version on server 2024-03-11T09:15:10.476 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-03-11T09:15:10.477 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T09:15:10.562 DEBUG:teuthology.orchestra.run.smithi100:> true 2024-03-11T09:15:10.728 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-03-11T09:15:10.729 DEBUG:teuthology.orchestra.run.smithi100:> uname -m 2024-03-11T09:15:10.782 INFO:teuthology.orchestra.run.smithi100.stdout:x86_64 2024-03-11T09:15:10.783 DEBUG:teuthology.orchestra.run.smithi100:> cat /etc/os-release 2024-03-11T09:15:10.836 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="CentOS Stream" 2024-03-11T09:15:10.836 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="9" 2024-03-11T09:15:10.837 INFO:teuthology.orchestra.run.smithi100.stdout:ID="centos" 2024-03-11T09:15:10.837 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE="rhel fedora" 2024-03-11T09:15:10.837 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="9" 2024-03-11T09:15:10.837 INFO:teuthology.orchestra.run.smithi100.stdout:PLATFORM_ID="platform:el9" 2024-03-11T09:15:10.837 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-11T09:15:10.837 INFO:teuthology.orchestra.run.smithi100.stdout:ANSI_COLOR="0;31" 2024-03-11T09:15:10.837 INFO:teuthology.orchestra.run.smithi100.stdout:LOGO="fedora-logo-icon" 2024-03-11T09:15:10.837 INFO:teuthology.orchestra.run.smithi100.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-11T09:15:10.837 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://centos.org/" 2024-03-11T09:15:10.837 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-11T09:15:10.837 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-11T09:15:10.837 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-11T09:15:10.838 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server 2024-03-11T09:15:10.859 INFO:teuthology.lock.ops:Updating [smithi170.front.sepia.ceph.com]: set os type and version on server 2024-03-11T09:15:10.859 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-03-11T09:15:10.861 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T09:15:10.948 DEBUG:teuthology.orchestra.run.smithi170:> true 2024-03-11T09:15:11.023 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-03-11T09:15:11.023 DEBUG:teuthology.orchestra.run.smithi170:> uname -m 2024-03-11T09:15:11.081 INFO:teuthology.orchestra.run.smithi170.stdout:x86_64 2024-03-11T09:15:11.082 DEBUG:teuthology.orchestra.run.smithi170:> cat /etc/os-release 2024-03-11T09:15:11.138 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="CentOS Stream" 2024-03-11T09:15:11.138 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="9" 2024-03-11T09:15:11.138 INFO:teuthology.orchestra.run.smithi170.stdout:ID="centos" 2024-03-11T09:15:11.139 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE="rhel fedora" 2024-03-11T09:15:11.139 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="9" 2024-03-11T09:15:11.139 INFO:teuthology.orchestra.run.smithi170.stdout:PLATFORM_ID="platform:el9" 2024-03-11T09:15:11.139 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-11T09:15:11.139 INFO:teuthology.orchestra.run.smithi170.stdout:ANSI_COLOR="0;31" 2024-03-11T09:15:11.139 INFO:teuthology.orchestra.run.smithi170.stdout:LOGO="fedora-logo-icon" 2024-03-11T09:15:11.139 INFO:teuthology.orchestra.run.smithi170.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-11T09:15:11.139 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://centos.org/" 2024-03-11T09:15:11.139 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-11T09:15:11.139 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-11T09:15:11.139 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-11T09:15:11.140 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server 2024-03-11T09:15:11.161 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T09:15:11.246 INFO:teuthology.dispatcher.supervisor:Running job 7590810 2024-03-11T09:15:11.246 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_rfriedma@teuthology --archive /home/teuthworker/archive/rfriedma-2024-03-11_09:06:05-smoke-wip-rf-compactref-distro-default-smithi/7590810 --name rfriedma-2024-03-11_09:06:05-smoke-wip-rf-compactref-distro-default-smithi --description smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_latest} tasks/{0-install test/cfuse_workunit_suites_iozone}} -- /home/teuthworker/archive/rfriedma-2024-03-11_09:06:05-smoke-wip-rf-compactref-distro-default-smithi/7590810/orig.config.yaml 2024-03-11T09:15:11.249 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rfriedma-2024-03-11_09:06:05-smoke-wip-rf-compactref-distro-default-smithi/7590810 2024-03-11T09:15:11.250 INFO:teuthology.dispatcher.supervisor:Job PID: 621962 2024-03-11T09:15:11.250 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-11T09:17:11.351 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T09:19:11.535 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T09:21:11.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T09:23:11.877 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T09:25:12.057 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T09:27:12.224 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T09:29:12.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T09:29:12.465 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1