2024-03-26T01:37:46.938 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-26T01:37:46.939 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T01:37:47.120 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f53013e5c10>, signals=[15]) 2024-03-26T01:37:47.120 INFO:teuthology.lock.ops:Start node 'smithi003.front.sepia.ceph.com' reimaging 2024-03-26T01:37:47.120 INFO:teuthology.lock.ops:Updating [smithi003.front.sepia.ceph.com]: reset os type and version on server 2024-03-26T01:37:47.120 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server 2024-03-26T01:37:47.150 INFO:teuthology.lock.ops:Start node 'smithi055.front.sepia.ceph.com' reimaging 2024-03-26T01:37:47.150 INFO:teuthology.lock.ops:Updating [smithi055.front.sepia.ceph.com]: reset os type and version on server 2024-03-26T01:37:47.150 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server 2024-03-26T01:37:47.175 INFO:teuthology.lock.ops:Start node 'smithi066.front.sepia.ceph.com' reimaging 2024-03-26T01:37:47.175 INFO:teuthology.lock.ops:Updating [smithi066.front.sepia.ceph.com]: reset os type and version on server 2024-03-26T01:37:47.175 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server 2024-03-26T01:37:47.268 DEBUG:teuthology.provision.fog.smithi003:Requesting image smithi_centos_9.stream (ID 10) 2024-03-26T01:37:47.288 DEBUG:teuthology.provision.fog.smithi055:Requesting image smithi_centos_9.stream (ID 10) 2024-03-26T01:37:47.306 DEBUG:teuthology.provision.fog.smithi066:Requesting image smithi_centos_9.stream (ID 10) 2024-03-26T01:37:47.315 INFO:teuthology.provision.fog.smithi003:Scheduling deploy of centos 9.stream 2024-03-26T01:37:47.334 INFO:teuthology.provision.fog.smithi055:Scheduling deploy of centos 9.stream 2024-03-26T01:37:47.347 INFO:teuthology.provision.fog.smithi066:Scheduling deploy of centos 9.stream 2024-03-26T01:37:47.553 INFO:teuthology.orchestra.console.smithi055:Power off 2024-03-26T01:37:47.554 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-26T01:37:47.572 INFO:teuthology.orchestra.console.smithi003:Power off 2024-03-26T01:37:47.572 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-26T01:37:47.583 DEBUG:teuthology.orchestra.console.smithi055:power off output: Chassis Power Control: Down/Off 2024-03-26T01:37:47.583 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T01:37:47.593 DEBUG:teuthology.orchestra.console.smithi003:power off output: Chassis Power Control: Down/Off 2024-03-26T01:37:47.593 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T01:37:47.606 INFO:teuthology.orchestra.console.smithi066:Power off 2024-03-26T01:37:47.606 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-26T01:37:47.613 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is on 2024-03-26T01:37:47.617 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is on 2024-03-26T01:37:47.631 DEBUG:teuthology.orchestra.console.smithi066:power off output: Chassis Power Control: Down/Off 2024-03-26T01:37:47.636 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T01:37:47.658 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is on 2024-03-26T01:37:51.618 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T01:37:51.627 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T01:37:51.660 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T01:37:51.729 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is on 2024-03-26T01:37:51.739 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is on 2024-03-26T01:37:51.770 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is on 2024-03-26T01:37:55.733 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T01:37:55.741 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T01:37:55.771 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T01:37:55.844 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is on 2024-03-26T01:37:55.850 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is off 2024-03-26T01:37:55.881 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is on 2024-03-26T01:37:55.950 INFO:teuthology.orchestra.console.smithi003:Power off completed 2024-03-26T01:37:56.051 INFO:teuthology.orchestra.console.smithi003:Power on 2024-03-26T01:37:56.051 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-26T01:37:56.078 DEBUG:teuthology.orchestra.console.smithi003:power on output: Chassis Power Control: Up/On 2024-03-26T01:37:56.079 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T01:37:56.121 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is off 2024-03-26T01:37:59.846 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T01:37:59.882 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T01:37:59.956 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is off 2024-03-26T01:37:59.991 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is off 2024-03-26T01:38:00.058 INFO:teuthology.orchestra.console.smithi055:Power off completed 2024-03-26T01:38:00.093 INFO:teuthology.orchestra.console.smithi066:Power off completed 2024-03-26T01:38:00.122 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T01:38:00.160 INFO:teuthology.orchestra.console.smithi055:Power on 2024-03-26T01:38:00.160 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-26T01:38:00.182 DEBUG:teuthology.orchestra.console.smithi055:power on output: Chassis Power Control: Up/On 2024-03-26T01:38:00.182 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T01:38:00.193 INFO:teuthology.orchestra.console.smithi066:Power on 2024-03-26T01:38:00.194 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-26T01:38:00.205 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is off 2024-03-26T01:38:00.217 DEBUG:teuthology.orchestra.console.smithi066:power on output: Chassis Power Control: Up/On 2024-03-26T01:38:00.218 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T01:38:00.231 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is off 2024-03-26T01:38:00.240 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is off 2024-03-26T01:38:04.206 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T01:38:04.232 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T01:38:04.241 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T01:38:04.317 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is off 2024-03-26T01:38:04.351 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is off 2024-03-26T01:38:04.442 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is on 2024-03-26T01:38:04.543 INFO:teuthology.orchestra.console.smithi003:Power on completed 2024-03-26T01:38:04.644 INFO:teuthology.provision.fog.smithi003:Waiting for deploy to finish 2024-03-26T01:38:08.320 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T01:38:08.353 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T01:38:08.462 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is on 2024-03-26T01:38:08.533 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is on 2024-03-26T01:38:08.563 INFO:teuthology.orchestra.console.smithi066:Power on completed 2024-03-26T01:38:08.634 INFO:teuthology.orchestra.console.smithi055:Power on completed 2024-03-26T01:38:08.664 INFO:teuthology.provision.fog.smithi066:Waiting for deploy to finish 2024-03-26T01:38:08.735 INFO:teuthology.provision.fog.smithi055:Waiting for deploy to finish 2024-03-26T01:40:24.487 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T01:40:24.627 ERROR:teuthology.orchestra.connection:Error authenticating with smithi055.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-03-26T01:40:35.499 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T01:40:38.558 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2024-03-26T01:40:44.560 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T01:40:47.618 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2024-03-26T01:40:53.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T01:40:56.674 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2024-03-26T01:41:02.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T01:41:03.134 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55 2024-03-26T01:41:05.726 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2024-03-26T01:41:09.136 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T01:41:11.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T01:41:12.194 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55 2024-03-26T01:41:14.786 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2024-03-26T01:41:18.196 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T01:41:20.787 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T01:41:39.849 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T01:41:42.914 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-03-26T01:41:48.915 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T01:41:51.966 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-03-26T01:41:57.968 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T01:42:01.026 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-03-26T01:42:07.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T01:42:10.083 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-03-26T01:42:16.084 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T01:42:18.198 WARNING:teuthology.provision.fog.smithi055:timed out 2024-03-26T01:42:19.170 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-03-26T01:42:20.791 WARNING:teuthology.provision.fog.smithi003:timed out 2024-03-26T01:42:24.200 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T01:42:24.482 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-26T01:42:24.483 DEBUG:teuthology.orchestra.run.smithi055:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-26T01:42:24.832 INFO:teuthology.provision.fog.smithi055:Node is ready 2024-03-26T01:42:24.832 DEBUG:teuthology.orchestra.run.smithi055:> hostname 2024-03-26T01:42:24.851 INFO:teuthology.orchestra.run.smithi055.stdout:smithi055.front.sepia.ceph.com 2024-03-26T01:42:24.852 DEBUG:teuthology.orchestra.run.smithi055:> grep smithi055.front.sepia.ceph.com /etc/hosts 2024-03-26T01:42:24.908 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55 smithi055.front.sepia.ceph.com smithi055 2024-03-26T01:42:24.908 DEBUG:teuthology.orchestra.run.smithi055:> sudo hostname smithi055 2024-03-26T01:42:25.040 DEBUG:teuthology.orchestra.run.smithi055:> sudo sed -i -e 's/smithi055.front.sepia.ceph.com/smithi055/g' /etc/hosts 2024-03-26T01:42:25.076 DEBUG:teuthology.orchestra.run.smithi055:> sudo sed -i -e 's/172.21.15.55/172.21.15.55/g' /etc/hosts 2024-03-26T01:42:25.149 DEBUG:teuthology.orchestra.run.smithi055:> sudo sed -i -e 's/smithi055.front.sepia.ceph.com/smithi055/g' /etc/hostname 2024-03-26T01:42:25.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T01:42:25.222 DEBUG:teuthology.orchestra.run.smithi055:> sudo hostname smithi055 2024-03-26T01:42:25.297 DEBUG:teuthology.orchestra.run.smithi055:> cat /etc/os-release 2024-03-26T01:42:25.350 INFO:teuthology.orchestra.run.smithi055.stdout:NAME="CentOS Stream" 2024-03-26T01:42:25.350 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION="9" 2024-03-26T01:42:25.350 INFO:teuthology.orchestra.run.smithi055.stdout:ID="centos" 2024-03-26T01:42:25.351 INFO:teuthology.orchestra.run.smithi055.stdout:ID_LIKE="rhel fedora" 2024-03-26T01:42:25.351 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION_ID="9" 2024-03-26T01:42:25.351 INFO:teuthology.orchestra.run.smithi055.stdout:PLATFORM_ID="platform:el9" 2024-03-26T01:42:25.351 INFO:teuthology.orchestra.run.smithi055.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-26T01:42:25.351 INFO:teuthology.orchestra.run.smithi055.stdout:ANSI_COLOR="0;31" 2024-03-26T01:42:25.351 INFO:teuthology.orchestra.run.smithi055.stdout:LOGO="fedora-logo-icon" 2024-03-26T01:42:25.351 INFO:teuthology.orchestra.run.smithi055.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-26T01:42:25.351 INFO:teuthology.orchestra.run.smithi055.stdout:HOME_URL="https://centos.org/" 2024-03-26T01:42:25.351 INFO:teuthology.orchestra.run.smithi055.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-26T01:42:25.351 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-26T01:42:25.351 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-26T01:42:25.352 INFO:teuthology.provision.fog.smithi055:Deploy complete! 2024-03-26T01:42:25.353 DEBUG:teuthology.parallel:result is None 2024-03-26T01:42:26.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T01:42:27.053 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-26T01:42:27.054 DEBUG:teuthology.orchestra.run.smithi003:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-26T01:42:27.386 INFO:teuthology.provision.fog.smithi003:Node is ready 2024-03-26T01:42:27.386 DEBUG:teuthology.orchestra.run.smithi003:> hostname 2024-03-26T01:42:27.402 INFO:teuthology.orchestra.run.smithi003.stdout:smithi003.front.sepia.ceph.com 2024-03-26T01:42:27.402 DEBUG:teuthology.orchestra.run.smithi003:> grep smithi003.front.sepia.ceph.com /etc/hosts 2024-03-26T01:42:27.458 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3 smithi003.front.sepia.ceph.com smithi003 2024-03-26T01:42:27.459 DEBUG:teuthology.orchestra.run.smithi003:> sudo hostname smithi003 2024-03-26T01:42:27.567 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/smithi003.front.sepia.ceph.com/smithi003/g' /etc/hosts 2024-03-26T01:42:27.599 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/172.21.15.3/172.21.15.3/g' /etc/hosts 2024-03-26T01:42:27.671 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/smithi003.front.sepia.ceph.com/smithi003/g' /etc/hostname 2024-03-26T01:42:27.744 DEBUG:teuthology.orchestra.run.smithi003:> sudo hostname smithi003 2024-03-26T01:42:27.815 DEBUG:teuthology.orchestra.run.smithi003:> cat /etc/os-release 2024-03-26T01:42:27.870 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="CentOS Stream" 2024-03-26T01:42:27.870 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="9" 2024-03-26T01:42:27.870 INFO:teuthology.orchestra.run.smithi003.stdout:ID="centos" 2024-03-26T01:42:27.870 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE="rhel fedora" 2024-03-26T01:42:27.870 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="9" 2024-03-26T01:42:27.871 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM_ID="platform:el9" 2024-03-26T01:42:27.871 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-26T01:42:27.871 INFO:teuthology.orchestra.run.smithi003.stdout:ANSI_COLOR="0;31" 2024-03-26T01:42:27.871 INFO:teuthology.orchestra.run.smithi003.stdout:LOGO="fedora-logo-icon" 2024-03-26T01:42:27.871 INFO:teuthology.orchestra.run.smithi003.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-26T01:42:27.871 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://centos.org/" 2024-03-26T01:42:27.871 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-26T01:42:27.871 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-26T01:42:27.871 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-26T01:42:27.871 INFO:teuthology.provision.fog.smithi003:Deploy complete! 2024-03-26T01:42:27.872 DEBUG:teuthology.parallel:result is None 2024-03-26T01:42:28.222 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-03-26T01:42:34.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T01:42:37.278 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-03-26T01:42:43.280 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T01:42:46.334 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-03-26T01:42:52.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T01:42:55.422 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-03-26T01:43:01.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T01:43:04.478 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-03-26T01:43:10.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T01:43:13.534 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-03-26T01:43:19.535 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T01:44:19.538 WARNING:teuthology.provision.fog.smithi066:timed out 2024-03-26T01:44:25.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T01:44:25.790 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-26T01:44:25.790 DEBUG:teuthology.orchestra.run.smithi066:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-26T01:44:26.130 INFO:teuthology.provision.fog.smithi066:Node is ready 2024-03-26T01:44:26.130 DEBUG:teuthology.orchestra.run.smithi066:> hostname 2024-03-26T01:44:26.145 INFO:teuthology.orchestra.run.smithi066.stdout:smithi066.front.sepia.ceph.com 2024-03-26T01:44:26.145 DEBUG:teuthology.orchestra.run.smithi066:> grep smithi066.front.sepia.ceph.com /etc/hosts 2024-03-26T01:44:26.200 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66 smithi066.front.sepia.ceph.com smithi066 2024-03-26T01:44:26.201 DEBUG:teuthology.orchestra.run.smithi066:> sudo hostname smithi066 2024-03-26T01:44:26.320 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i -e 's/smithi066.front.sepia.ceph.com/smithi066/g' /etc/hosts 2024-03-26T01:44:26.351 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i -e 's/172.21.15.66/172.21.15.66/g' /etc/hosts 2024-03-26T01:44:26.422 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i -e 's/smithi066.front.sepia.ceph.com/smithi066/g' /etc/hostname 2024-03-26T01:44:26.493 DEBUG:teuthology.orchestra.run.smithi066:> sudo hostname smithi066 2024-03-26T01:44:26.564 DEBUG:teuthology.orchestra.run.smithi066:> cat /etc/os-release 2024-03-26T01:44:26.618 INFO:teuthology.orchestra.run.smithi066.stdout:NAME="CentOS Stream" 2024-03-26T01:44:26.618 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION="9" 2024-03-26T01:44:26.618 INFO:teuthology.orchestra.run.smithi066.stdout:ID="centos" 2024-03-26T01:44:26.619 INFO:teuthology.orchestra.run.smithi066.stdout:ID_LIKE="rhel fedora" 2024-03-26T01:44:26.619 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_ID="9" 2024-03-26T01:44:26.619 INFO:teuthology.orchestra.run.smithi066.stdout:PLATFORM_ID="platform:el9" 2024-03-26T01:44:26.619 INFO:teuthology.orchestra.run.smithi066.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-26T01:44:26.619 INFO:teuthology.orchestra.run.smithi066.stdout:ANSI_COLOR="0;31" 2024-03-26T01:44:26.619 INFO:teuthology.orchestra.run.smithi066.stdout:LOGO="fedora-logo-icon" 2024-03-26T01:44:26.619 INFO:teuthology.orchestra.run.smithi066.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-26T01:44:26.619 INFO:teuthology.orchestra.run.smithi066.stdout:HOME_URL="https://centos.org/" 2024-03-26T01:44:26.619 INFO:teuthology.orchestra.run.smithi066.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-26T01:44:26.619 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-26T01:44:26.619 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-26T01:44:26.620 INFO:teuthology.provision.fog.smithi066:Deploy complete! 2024-03-26T01:44:26.620 DEBUG:teuthology.parallel:result is None 2024-03-26T01:44:26.842 INFO:teuthology.lock.ops:Checking smithi003.front.sepia.ceph.com 2024-03-26T01:44:26.843 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-26T01:44:26.865 INFO:teuthology.lock.ops:Checking smithi055.front.sepia.ceph.com 2024-03-26T01:44:26.865 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-26T01:44:26.889 INFO:teuthology.lock.ops:Checking smithi066.front.sepia.ceph.com 2024-03-26T01:44:26.889 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-26T01:44:26.907 INFO:teuthology.lock.ops:Updating [smithi003.front.sepia.ceph.com]: set os type and version on server 2024-03-26T01:44:26.907 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com' 2024-03-26T01:44:26.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T01:44:27.011 DEBUG:teuthology.orchestra.run.smithi003:> true 2024-03-26T01:44:27.193 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi003.front.sepia.ceph.com' 2024-03-26T01:44:27.193 DEBUG:teuthology.orchestra.run.smithi003:> uname -m 2024-03-26T01:44:27.250 INFO:teuthology.orchestra.run.smithi003.stdout:x86_64 2024-03-26T01:44:27.251 DEBUG:teuthology.orchestra.run.smithi003:> cat /etc/os-release 2024-03-26T01:44:27.305 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="CentOS Stream" 2024-03-26T01:44:27.305 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="9" 2024-03-26T01:44:27.306 INFO:teuthology.orchestra.run.smithi003.stdout:ID="centos" 2024-03-26T01:44:27.306 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE="rhel fedora" 2024-03-26T01:44:27.306 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="9" 2024-03-26T01:44:27.306 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM_ID="platform:el9" 2024-03-26T01:44:27.306 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-26T01:44:27.306 INFO:teuthology.orchestra.run.smithi003.stdout:ANSI_COLOR="0;31" 2024-03-26T01:44:27.306 INFO:teuthology.orchestra.run.smithi003.stdout:LOGO="fedora-logo-icon" 2024-03-26T01:44:27.306 INFO:teuthology.orchestra.run.smithi003.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-26T01:44:27.306 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://centos.org/" 2024-03-26T01:44:27.306 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-26T01:44:27.306 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-26T01:44:27.306 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-26T01:44:27.307 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server 2024-03-26T01:44:27.332 INFO:teuthology.lock.ops:Updating [smithi055.front.sepia.ceph.com]: set os type and version on server 2024-03-26T01:44:27.332 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2024-03-26T01:44:27.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T01:44:27.437 DEBUG:teuthology.orchestra.run.smithi055:> true 2024-03-26T01:44:27.616 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi055.front.sepia.ceph.com' 2024-03-26T01:44:27.617 DEBUG:teuthology.orchestra.run.smithi055:> uname -m 2024-03-26T01:44:27.671 INFO:teuthology.orchestra.run.smithi055.stdout:x86_64 2024-03-26T01:44:27.671 DEBUG:teuthology.orchestra.run.smithi055:> cat /etc/os-release 2024-03-26T01:44:27.726 INFO:teuthology.orchestra.run.smithi055.stdout:NAME="CentOS Stream" 2024-03-26T01:44:27.726 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION="9" 2024-03-26T01:44:27.726 INFO:teuthology.orchestra.run.smithi055.stdout:ID="centos" 2024-03-26T01:44:27.726 INFO:teuthology.orchestra.run.smithi055.stdout:ID_LIKE="rhel fedora" 2024-03-26T01:44:27.726 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION_ID="9" 2024-03-26T01:44:27.726 INFO:teuthology.orchestra.run.smithi055.stdout:PLATFORM_ID="platform:el9" 2024-03-26T01:44:27.726 INFO:teuthology.orchestra.run.smithi055.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-26T01:44:27.726 INFO:teuthology.orchestra.run.smithi055.stdout:ANSI_COLOR="0;31" 2024-03-26T01:44:27.727 INFO:teuthology.orchestra.run.smithi055.stdout:LOGO="fedora-logo-icon" 2024-03-26T01:44:27.727 INFO:teuthology.orchestra.run.smithi055.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-26T01:44:27.727 INFO:teuthology.orchestra.run.smithi055.stdout:HOME_URL="https://centos.org/" 2024-03-26T01:44:27.727 INFO:teuthology.orchestra.run.smithi055.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-26T01:44:27.727 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-26T01:44:27.727 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-26T01:44:27.727 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server 2024-03-26T01:44:27.748 INFO:teuthology.lock.ops:Updating [smithi066.front.sepia.ceph.com]: set os type and version on server 2024-03-26T01:44:27.748 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-03-26T01:44:27.749 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T01:44:27.850 DEBUG:teuthology.orchestra.run.smithi066:> true 2024-03-26T01:44:27.919 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-03-26T01:44:27.919 DEBUG:teuthology.orchestra.run.smithi066:> uname -m 2024-03-26T01:44:27.976 INFO:teuthology.orchestra.run.smithi066.stdout:x86_64 2024-03-26T01:44:27.977 DEBUG:teuthology.orchestra.run.smithi066:> cat /etc/os-release 2024-03-26T01:44:28.034 INFO:teuthology.orchestra.run.smithi066.stdout:NAME="CentOS Stream" 2024-03-26T01:44:28.034 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION="9" 2024-03-26T01:44:28.034 INFO:teuthology.orchestra.run.smithi066.stdout:ID="centos" 2024-03-26T01:44:28.034 INFO:teuthology.orchestra.run.smithi066.stdout:ID_LIKE="rhel fedora" 2024-03-26T01:44:28.034 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_ID="9" 2024-03-26T01:44:28.034 INFO:teuthology.orchestra.run.smithi066.stdout:PLATFORM_ID="platform:el9" 2024-03-26T01:44:28.035 INFO:teuthology.orchestra.run.smithi066.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-26T01:44:28.035 INFO:teuthology.orchestra.run.smithi066.stdout:ANSI_COLOR="0;31" 2024-03-26T01:44:28.035 INFO:teuthology.orchestra.run.smithi066.stdout:LOGO="fedora-logo-icon" 2024-03-26T01:44:28.035 INFO:teuthology.orchestra.run.smithi066.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-26T01:44:28.035 INFO:teuthology.orchestra.run.smithi066.stdout:HOME_URL="https://centos.org/" 2024-03-26T01:44:28.035 INFO:teuthology.orchestra.run.smithi066.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-26T01:44:28.035 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-26T01:44:28.035 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-26T01:44:28.035 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server 2024-03-26T01:44:28.058 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T01:44:28.150 INFO:teuthology.dispatcher.supervisor:Running job 7621927 2024-03-26T01:44:28.151 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-03-25_21:08:11-orch-squid-distro-default-smithi/7621927 --name teuthology-2024-03-25_21:08:11-orch-squid-distro-default-smithi --description orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/classic start} -- /home/teuthworker/archive/teuthology-2024-03-25_21:08:11-orch-squid-distro-default-smithi/7621927/orig.config.yaml 2024-03-26T01:44:28.154 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-03-25_21:08:11-orch-squid-distro-default-smithi/7621927 2024-03-26T01:44:28.154 INFO:teuthology.dispatcher.supervisor:Job PID: 3606969 2024-03-26T01:44:28.154 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-26T01:46:28.156 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T01:48:28.221 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T01:50:28.293 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T01:52:28.365 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T01:54:28.445 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T01:56:28.518 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T01:58:28.598 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T02:00:28.670 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T02:02:28.754 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T02:02:28.826 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1