2024-03-26T02:03:02.306 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-26T02:03:02.306 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T02:03:02.470 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7db4a23c10>, signals=[15]) 2024-03-26T02:03:02.471 INFO:teuthology.lock.ops:Start node 'smithi066.front.sepia.ceph.com' reimaging 2024-03-26T02:03:02.471 INFO:teuthology.lock.ops:Updating [smithi066.front.sepia.ceph.com]: reset os type and version on server 2024-03-26T02:03:02.471 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server 2024-03-26T02:03:02.493 INFO:teuthology.lock.ops:Start node 'smithi189.front.sepia.ceph.com' reimaging 2024-03-26T02:03:02.494 INFO:teuthology.lock.ops:Updating [smithi189.front.sepia.ceph.com]: reset os type and version on server 2024-03-26T02:03:02.494 INFO:teuthology.lock.ops:Updating smithi189.front.sepia.ceph.com on lock server 2024-03-26T02:03:02.518 INFO:teuthology.lock.ops:Start node 'smithi193.front.sepia.ceph.com' reimaging 2024-03-26T02:03:02.518 INFO:teuthology.lock.ops:Updating [smithi193.front.sepia.ceph.com]: reset os type and version on server 2024-03-26T02:03:02.518 INFO:teuthology.lock.ops:Updating smithi193.front.sepia.ceph.com on lock server 2024-03-26T02:03:02.614 DEBUG:teuthology.provision.fog.smithi066:Requesting image smithi_centos_9.stream (ID 10) 2024-03-26T02:03:02.640 DEBUG:teuthology.provision.fog.smithi189:Requesting image smithi_centos_9.stream (ID 10) 2024-03-26T02:03:02.650 INFO:teuthology.provision.fog.smithi066:Scheduling deploy of centos 9.stream 2024-03-26T02:03:02.665 DEBUG:teuthology.provision.fog.smithi193:Requesting image smithi_centos_9.stream (ID 10) 2024-03-26T02:03:02.678 INFO:teuthology.provision.fog.smithi189:Scheduling deploy of centos 9.stream 2024-03-26T02:03:02.717 INFO:teuthology.provision.fog.smithi193:Scheduling deploy of centos 9.stream 2024-03-26T02:03:02.874 INFO:teuthology.orchestra.console.smithi189:Power off 2024-03-26T02:03:02.875 DEBUG:teuthology.orchestra.console.smithi189:pexpect command: ipmitool -H smithi189.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-26T02:03:02.891 INFO:teuthology.orchestra.console.smithi066:Power off 2024-03-26T02:03:02.891 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-26T02:03:02.901 DEBUG:teuthology.orchestra.console.smithi189:power off output: Chassis Power Control: Down/Off 2024-03-26T02:03:02.901 DEBUG:teuthology.orchestra.console.smithi189:pexpect command: ipmitool -H smithi189.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T02:03:02.919 DEBUG:teuthology.orchestra.console.smithi066:power off output: Chassis Power Control: Down/Off 2024-03-26T02:03:02.920 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T02:03:02.931 DEBUG:teuthology.orchestra.console.smithi189:check power output: Chassis Power is off 2024-03-26T02:03:02.943 INFO:teuthology.orchestra.console.smithi193:Power off 2024-03-26T02:03:02.943 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-26T02:03:02.953 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is off 2024-03-26T02:03:02.967 DEBUG:teuthology.orchestra.console.smithi193:power off output: Chassis Power Control: Down/Off 2024-03-26T02:03:02.967 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T02:03:02.989 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is on 2024-03-26T02:03:03.033 INFO:teuthology.orchestra.console.smithi189:Power off completed 2024-03-26T02:03:03.054 INFO:teuthology.orchestra.console.smithi066:Power off completed 2024-03-26T02:03:03.134 INFO:teuthology.orchestra.console.smithi189:Power on 2024-03-26T02:03:03.134 DEBUG:teuthology.orchestra.console.smithi189:pexpect command: ipmitool -H smithi189.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-26T02:03:03.155 INFO:teuthology.orchestra.console.smithi066:Power on 2024-03-26T02:03:03.155 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-26T02:03:03.163 DEBUG:teuthology.orchestra.console.smithi189:power on output: Chassis Power Control: Up/On 2024-03-26T02:03:03.164 DEBUG:teuthology.orchestra.console.smithi189:pexpect command: ipmitool -H smithi189.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T02:03:03.179 DEBUG:teuthology.orchestra.console.smithi066:power on output: Chassis Power Control: Up/On 2024-03-26T02:03:03.180 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T02:03:03.206 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is off 2024-03-26T02:03:03.216 DEBUG:teuthology.orchestra.console.smithi189:check power output: Chassis Power is off 2024-03-26T02:03:06.994 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T02:03:07.104 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is on 2024-03-26T02:03:07.207 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T02:03:07.217 DEBUG:teuthology.orchestra.console.smithi189:pexpect command: ipmitool -H smithi189.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T02:03:07.317 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is off 2024-03-26T02:03:07.325 DEBUG:teuthology.orchestra.console.smithi189:check power output: Chassis Power is off 2024-03-26T02:03:11.106 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T02:03:11.215 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is off 2024-03-26T02:03:11.318 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T02:03:11.326 INFO:teuthology.orchestra.console.smithi193:Power off completed 2024-03-26T02:03:11.327 DEBUG:teuthology.orchestra.console.smithi189:pexpect command: ipmitool -H smithi189.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T02:03:11.427 INFO:teuthology.orchestra.console.smithi193:Power on 2024-03-26T02:03:11.427 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-26T02:03:11.437 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is on 2024-03-26T02:03:11.438 DEBUG:teuthology.orchestra.console.smithi189:check power output: Chassis Power is on 2024-03-26T02:03:11.451 DEBUG:teuthology.orchestra.console.smithi193:power on output: Chassis Power Control: Up/On 2024-03-26T02:03:11.451 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T02:03:11.478 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is off 2024-03-26T02:03:11.538 INFO:teuthology.orchestra.console.smithi066:Power on completed 2024-03-26T02:03:11.539 INFO:teuthology.orchestra.console.smithi189:Power on completed 2024-03-26T02:03:11.639 INFO:teuthology.provision.fog.smithi066:Waiting for deploy to finish 2024-03-26T02:03:11.644 INFO:teuthology.provision.fog.smithi189:Waiting for deploy to finish 2024-03-26T02:03:15.482 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T02:03:15.592 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is off 2024-03-26T02:03:19.594 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T02:03:19.703 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is on 2024-03-26T02:03:19.804 INFO:teuthology.orchestra.console.smithi193:Power on completed 2024-03-26T02:03:19.905 INFO:teuthology.provision.fog.smithi193:Waiting for deploy to finish 2024-03-26T02:05:50.901 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T02:05:53.982 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2024-03-26T02:05:57.703 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T02:05:59.986 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T02:06:00.766 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T02:06:03.038 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2024-03-26T02:06:06.771 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T02:06:09.042 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T02:06:09.822 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T02:06:12.094 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2024-03-26T02:06:15.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T02:06:18.097 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T02:06:18.878 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T02:06:21.150 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2024-03-26T02:06:24.883 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T02:06:27.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T02:06:27.938 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T02:06:30.206 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2024-03-26T02:06:33.942 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T02:06:36.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T02:06:37.022 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T02:06:39.262 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2024-03-26T02:06:42.874 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T02:06:43.024 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T02:06:45.264 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T02:06:45.954 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-03-26T02:06:46.082 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T02:06:51.961 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T02:06:52.084 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T02:06:55.038 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-03-26T02:06:55.134 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T02:07:01.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T02:07:01.136 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T02:07:03.710 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2024-03-26T02:07:04.094 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-03-26T02:07:09.718 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T02:07:10.099 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T02:07:12.798 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2024-03-26T02:07:13.150 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-03-26T02:07:18.803 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T02:07:19.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T02:07:19.582 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T02:07:21.854 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193 2024-03-26T02:07:22.210 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-03-26T02:07:25.586 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T02:07:27.858 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T02:07:28.138 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-26T02:07:28.139 DEBUG:teuthology.orchestra.run.smithi193:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-26T02:07:28.211 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T02:07:28.638 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T02:07:31.263 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-03-26T02:07:34.639 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T02:07:37.265 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T02:07:37.694 WARNING:teuthology.provision.fog.smithi189:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-03-26T02:07:40.322 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-03-26T02:07:43.660 INFO:teuthology.provision.fog.smithi193:Node is ready 2024-03-26T02:07:43.660 DEBUG:teuthology.orchestra.run.smithi193:> hostname 2024-03-26T02:07:43.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T02:07:43.718 INFO:teuthology.orchestra.run.smithi193.stdout:smithi193.front.sepia.ceph.com 2024-03-26T02:07:43.719 DEBUG:teuthology.orchestra.run.smithi193:> grep smithi193.front.sepia.ceph.com /etc/hosts 2024-03-26T02:07:43.789 INFO:teuthology.orchestra.run.smithi193.stdout:172.21.15.193 smithi193.front.sepia.ceph.com smithi193 2024-03-26T02:07:43.789 DEBUG:teuthology.orchestra.run.smithi193:> sudo hostname smithi193 2024-03-26T02:07:43.910 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/smithi193.front.sepia.ceph.com/smithi193/g' /etc/hosts 2024-03-26T02:07:43.936 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-26T02:07:43.936 DEBUG:teuthology.orchestra.run.smithi189:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-26T02:07:43.938 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/172.21.15.193/172.21.15.193/g' /etc/hosts 2024-03-26T02:07:44.006 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/smithi193.front.sepia.ceph.com/smithi193/g' /etc/hostname 2024-03-26T02:07:44.074 DEBUG:teuthology.orchestra.run.smithi193:> sudo hostname smithi193 2024-03-26T02:07:44.141 DEBUG:teuthology.orchestra.run.smithi193:> cat /etc/os-release 2024-03-26T02:07:44.196 INFO:teuthology.orchestra.run.smithi193.stdout:NAME="CentOS Stream" 2024-03-26T02:07:44.196 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION="9" 2024-03-26T02:07:44.196 INFO:teuthology.orchestra.run.smithi193.stdout:ID="centos" 2024-03-26T02:07:44.197 INFO:teuthology.orchestra.run.smithi193.stdout:ID_LIKE="rhel fedora" 2024-03-26T02:07:44.197 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION_ID="9" 2024-03-26T02:07:44.197 INFO:teuthology.orchestra.run.smithi193.stdout:PLATFORM_ID="platform:el9" 2024-03-26T02:07:44.197 INFO:teuthology.orchestra.run.smithi193.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-26T02:07:44.197 INFO:teuthology.orchestra.run.smithi193.stdout:ANSI_COLOR="0;31" 2024-03-26T02:07:44.197 INFO:teuthology.orchestra.run.smithi193.stdout:LOGO="fedora-logo-icon" 2024-03-26T02:07:44.197 INFO:teuthology.orchestra.run.smithi193.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-26T02:07:44.197 INFO:teuthology.orchestra.run.smithi193.stdout:HOME_URL="https://centos.org/" 2024-03-26T02:07:44.197 INFO:teuthology.orchestra.run.smithi193.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-26T02:07:44.197 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-26T02:07:44.197 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-26T02:07:44.198 INFO:teuthology.provision.fog.smithi193:Deploy complete! 2024-03-26T02:07:44.200 DEBUG:teuthology.parallel:result is None 2024-03-26T02:07:46.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T02:07:49.378 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-03-26T02:07:55.380 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T02:07:58.430 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-03-26T02:07:59.331 INFO:teuthology.provision.fog.smithi189:Node is ready 2024-03-26T02:07:59.332 DEBUG:teuthology.orchestra.run.smithi189:> hostname 2024-03-26T02:07:59.349 INFO:teuthology.orchestra.run.smithi189.stdout:smithi046 2024-03-26T02:07:59.350 DEBUG:teuthology.orchestra.run.smithi189:> grep smithi046 /etc/hosts 2024-03-26T02:07:59.407 INFO:teuthology.orchestra.run.smithi189.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2024-03-26T02:07:59.407 DEBUG:teuthology.orchestra.run.smithi189:> sudo hostname smithi189 2024-03-26T02:07:59.545 DEBUG:teuthology.orchestra.run.smithi189:> sudo sed -i -e 's/smithi046/smithi189/g' /etc/hosts 2024-03-26T02:07:59.576 DEBUG:teuthology.orchestra.run.smithi189:> sudo sed -i -e 's/172.21.15.46/172.21.15.189/g' /etc/hosts 2024-03-26T02:07:59.646 DEBUG:teuthology.orchestra.run.smithi189:> sudo sed -i -e 's/smithi046/smithi189/g' /etc/hostname 2024-03-26T02:07:59.716 DEBUG:teuthology.orchestra.run.smithi189:> sudo hostname smithi189 2024-03-26T02:07:59.783 DEBUG:teuthology.orchestra.run.smithi189:> cat /etc/os-release 2024-03-26T02:07:59.839 INFO:teuthology.orchestra.run.smithi189.stdout:NAME="CentOS Stream" 2024-03-26T02:07:59.839 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION="9" 2024-03-26T02:07:59.839 INFO:teuthology.orchestra.run.smithi189.stdout:ID="centos" 2024-03-26T02:07:59.839 INFO:teuthology.orchestra.run.smithi189.stdout:ID_LIKE="rhel fedora" 2024-03-26T02:07:59.839 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION_ID="9" 2024-03-26T02:07:59.839 INFO:teuthology.orchestra.run.smithi189.stdout:PLATFORM_ID="platform:el9" 2024-03-26T02:07:59.839 INFO:teuthology.orchestra.run.smithi189.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-26T02:07:59.839 INFO:teuthology.orchestra.run.smithi189.stdout:ANSI_COLOR="0;31" 2024-03-26T02:07:59.839 INFO:teuthology.orchestra.run.smithi189.stdout:LOGO="fedora-logo-icon" 2024-03-26T02:07:59.839 INFO:teuthology.orchestra.run.smithi189.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-26T02:07:59.839 INFO:teuthology.orchestra.run.smithi189.stdout:HOME_URL="https://centos.org/" 2024-03-26T02:07:59.839 INFO:teuthology.orchestra.run.smithi189.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-26T02:07:59.839 INFO:teuthology.orchestra.run.smithi189.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-26T02:07:59.840 INFO:teuthology.orchestra.run.smithi189.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-26T02:07:59.840 INFO:teuthology.provision.fog.smithi189:Deploy complete! 2024-03-26T02:07:59.840 DEBUG:teuthology.parallel:result is None 2024-03-26T02:08:04.432 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T02:08:07.486 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-03-26T02:08:13.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T02:08:16.542 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-03-26T02:08:22.543 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T02:09:22.546 WARNING:teuthology.provision.fog.smithi066:timed out 2024-03-26T02:09:28.549 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T02:09:28.779 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-26T02:09:28.779 DEBUG:teuthology.orchestra.run.smithi066:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-26T02:09:29.119 INFO:teuthology.provision.fog.smithi066:Node is ready 2024-03-26T02:09:29.119 DEBUG:teuthology.orchestra.run.smithi066:> hostname 2024-03-26T02:09:29.134 INFO:teuthology.orchestra.run.smithi066.stdout:smithi066.front.sepia.ceph.com 2024-03-26T02:09:29.135 DEBUG:teuthology.orchestra.run.smithi066:> grep smithi066.front.sepia.ceph.com /etc/hosts 2024-03-26T02:09:29.190 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66 smithi066.front.sepia.ceph.com smithi066 2024-03-26T02:09:29.191 DEBUG:teuthology.orchestra.run.smithi066:> sudo hostname smithi066 2024-03-26T02:09:29.302 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i -e 's/smithi066.front.sepia.ceph.com/smithi066/g' /etc/hosts 2024-03-26T02:09:29.334 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i -e 's/172.21.15.66/172.21.15.66/g' /etc/hosts 2024-03-26T02:09:29.405 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i -e 's/smithi066.front.sepia.ceph.com/smithi066/g' /etc/hostname 2024-03-26T02:09:29.476 DEBUG:teuthology.orchestra.run.smithi066:> sudo hostname smithi066 2024-03-26T02:09:29.545 DEBUG:teuthology.orchestra.run.smithi066:> cat /etc/os-release 2024-03-26T02:09:29.600 INFO:teuthology.orchestra.run.smithi066.stdout:NAME="CentOS Stream" 2024-03-26T02:09:29.601 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION="9" 2024-03-26T02:09:29.601 INFO:teuthology.orchestra.run.smithi066.stdout:ID="centos" 2024-03-26T02:09:29.601 INFO:teuthology.orchestra.run.smithi066.stdout:ID_LIKE="rhel fedora" 2024-03-26T02:09:29.601 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_ID="9" 2024-03-26T02:09:29.601 INFO:teuthology.orchestra.run.smithi066.stdout:PLATFORM_ID="platform:el9" 2024-03-26T02:09:29.601 INFO:teuthology.orchestra.run.smithi066.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-26T02:09:29.601 INFO:teuthology.orchestra.run.smithi066.stdout:ANSI_COLOR="0;31" 2024-03-26T02:09:29.601 INFO:teuthology.orchestra.run.smithi066.stdout:LOGO="fedora-logo-icon" 2024-03-26T02:09:29.601 INFO:teuthology.orchestra.run.smithi066.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-26T02:09:29.601 INFO:teuthology.orchestra.run.smithi066.stdout:HOME_URL="https://centos.org/" 2024-03-26T02:09:29.601 INFO:teuthology.orchestra.run.smithi066.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-26T02:09:29.601 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-26T02:09:29.601 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-26T02:09:29.602 INFO:teuthology.provision.fog.smithi066:Deploy complete! 2024-03-26T02:09:29.603 DEBUG:teuthology.parallel:result is None 2024-03-26T02:09:29.820 INFO:teuthology.lock.ops:Checking smithi066.front.sepia.ceph.com 2024-03-26T02:09:29.820 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-26T02:09:29.839 INFO:teuthology.lock.ops:Checking smithi189.front.sepia.ceph.com 2024-03-26T02:09:29.839 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-26T02:09:29.855 INFO:teuthology.lock.ops:Checking smithi193.front.sepia.ceph.com 2024-03-26T02:09:29.855 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-26T02:09:29.873 INFO:teuthology.lock.ops:Updating [smithi066.front.sepia.ceph.com]: set os type and version on server 2024-03-26T02:09:29.873 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-03-26T02:09:29.874 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T02:09:29.972 DEBUG:teuthology.orchestra.run.smithi066:> true 2024-03-26T02:09:30.041 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-03-26T02:09:30.041 DEBUG:teuthology.orchestra.run.smithi066:> uname -m 2024-03-26T02:09:30.095 INFO:teuthology.orchestra.run.smithi066.stdout:x86_64 2024-03-26T02:09:30.095 DEBUG:teuthology.orchestra.run.smithi066:> cat /etc/os-release 2024-03-26T02:09:30.150 INFO:teuthology.orchestra.run.smithi066.stdout:NAME="CentOS Stream" 2024-03-26T02:09:30.153 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION="9" 2024-03-26T02:09:30.153 INFO:teuthology.orchestra.run.smithi066.stdout:ID="centos" 2024-03-26T02:09:30.153 INFO:teuthology.orchestra.run.smithi066.stdout:ID_LIKE="rhel fedora" 2024-03-26T02:09:30.153 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_ID="9" 2024-03-26T02:09:30.153 INFO:teuthology.orchestra.run.smithi066.stdout:PLATFORM_ID="platform:el9" 2024-03-26T02:09:30.153 INFO:teuthology.orchestra.run.smithi066.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-26T02:09:30.153 INFO:teuthology.orchestra.run.smithi066.stdout:ANSI_COLOR="0;31" 2024-03-26T02:09:30.153 INFO:teuthology.orchestra.run.smithi066.stdout:LOGO="fedora-logo-icon" 2024-03-26T02:09:30.153 INFO:teuthology.orchestra.run.smithi066.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-26T02:09:30.154 INFO:teuthology.orchestra.run.smithi066.stdout:HOME_URL="https://centos.org/" 2024-03-26T02:09:30.154 INFO:teuthology.orchestra.run.smithi066.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-26T02:09:30.154 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-26T02:09:30.154 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-26T02:09:30.154 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server 2024-03-26T02:09:30.172 INFO:teuthology.lock.ops:Updating [smithi189.front.sepia.ceph.com]: set os type and version on server 2024-03-26T02:09:30.172 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-03-26T02:09:30.173 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T02:09:30.259 DEBUG:teuthology.orchestra.run.smithi189:> true 2024-03-26T02:09:30.332 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-03-26T02:09:30.332 DEBUG:teuthology.orchestra.run.smithi189:> uname -m 2024-03-26T02:09:30.388 INFO:teuthology.orchestra.run.smithi189.stdout:x86_64 2024-03-26T02:09:30.388 DEBUG:teuthology.orchestra.run.smithi189:> cat /etc/os-release 2024-03-26T02:09:30.444 INFO:teuthology.orchestra.run.smithi189.stdout:NAME="CentOS Stream" 2024-03-26T02:09:30.444 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION="9" 2024-03-26T02:09:30.444 INFO:teuthology.orchestra.run.smithi189.stdout:ID="centos" 2024-03-26T02:09:30.444 INFO:teuthology.orchestra.run.smithi189.stdout:ID_LIKE="rhel fedora" 2024-03-26T02:09:30.444 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION_ID="9" 2024-03-26T02:09:30.444 INFO:teuthology.orchestra.run.smithi189.stdout:PLATFORM_ID="platform:el9" 2024-03-26T02:09:30.444 INFO:teuthology.orchestra.run.smithi189.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-26T02:09:30.445 INFO:teuthology.orchestra.run.smithi189.stdout:ANSI_COLOR="0;31" 2024-03-26T02:09:30.445 INFO:teuthology.orchestra.run.smithi189.stdout:LOGO="fedora-logo-icon" 2024-03-26T02:09:30.445 INFO:teuthology.orchestra.run.smithi189.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-26T02:09:30.445 INFO:teuthology.orchestra.run.smithi189.stdout:HOME_URL="https://centos.org/" 2024-03-26T02:09:30.445 INFO:teuthology.orchestra.run.smithi189.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-26T02:09:30.445 INFO:teuthology.orchestra.run.smithi189.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-26T02:09:30.445 INFO:teuthology.orchestra.run.smithi189.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-26T02:09:30.445 INFO:teuthology.lock.ops:Updating smithi189.front.sepia.ceph.com on lock server 2024-03-26T02:09:30.489 INFO:teuthology.lock.ops:Updating [smithi193.front.sepia.ceph.com]: set os type and version on server 2024-03-26T02:09:30.489 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi193.front.sepia.ceph.com' 2024-03-26T02:09:30.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T02:09:30.578 DEBUG:teuthology.orchestra.run.smithi193:> true 2024-03-26T02:09:30.748 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi193.front.sepia.ceph.com' 2024-03-26T02:09:30.749 DEBUG:teuthology.orchestra.run.smithi193:> uname -m 2024-03-26T02:09:30.803 INFO:teuthology.orchestra.run.smithi193.stdout:x86_64 2024-03-26T02:09:30.804 DEBUG:teuthology.orchestra.run.smithi193:> cat /etc/os-release 2024-03-26T02:09:30.858 INFO:teuthology.orchestra.run.smithi193.stdout:NAME="CentOS Stream" 2024-03-26T02:09:30.858 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION="9" 2024-03-26T02:09:30.858 INFO:teuthology.orchestra.run.smithi193.stdout:ID="centos" 2024-03-26T02:09:30.859 INFO:teuthology.orchestra.run.smithi193.stdout:ID_LIKE="rhel fedora" 2024-03-26T02:09:30.859 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION_ID="9" 2024-03-26T02:09:30.859 INFO:teuthology.orchestra.run.smithi193.stdout:PLATFORM_ID="platform:el9" 2024-03-26T02:09:30.859 INFO:teuthology.orchestra.run.smithi193.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-26T02:09:30.859 INFO:teuthology.orchestra.run.smithi193.stdout:ANSI_COLOR="0;31" 2024-03-26T02:09:30.859 INFO:teuthology.orchestra.run.smithi193.stdout:LOGO="fedora-logo-icon" 2024-03-26T02:09:30.859 INFO:teuthology.orchestra.run.smithi193.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-26T02:09:30.859 INFO:teuthology.orchestra.run.smithi193.stdout:HOME_URL="https://centos.org/" 2024-03-26T02:09:30.859 INFO:teuthology.orchestra.run.smithi193.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-26T02:09:30.859 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-26T02:09:30.859 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-26T02:09:30.860 INFO:teuthology.lock.ops:Updating smithi193.front.sepia.ceph.com on lock server 2024-03-26T02:09:30.881 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T02:09:30.974 INFO:teuthology.dispatcher.supervisor:Running job 7622367 2024-03-26T02:09:30.974 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_adking@teuthology --archive /home/teuthworker/archive/adking-2024-03-26_01:50:53-orch:cephadm-wip-adk-testing-2024-03-25-1628-distro-default-smithi/7622367 --name adking-2024-03-26_01:50:53-orch:cephadm-wip-adk-testing-2024-03-25-1628-distro-default-smithi --description orch:cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/classic start} -- /home/teuthworker/archive/adking-2024-03-26_01:50:53-orch:cephadm-wip-adk-testing-2024-03-25-1628-distro-default-smithi/7622367/orig.config.yaml 2024-03-26T02:09:30.978 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/adking-2024-03-26_01:50:53-orch:cephadm-wip-adk-testing-2024-03-25-1628-distro-default-smithi/7622367 2024-03-26T02:09:30.978 INFO:teuthology.dispatcher.supervisor:Job PID: 3731884 2024-03-26T02:09:30.978 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-26T02:11:31.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T02:13:31.261 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T02:15:31.406 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T02:17:31.583 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T02:19:31.751 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T02:21:31.912 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T02:23:31.989 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T02:25:32.168 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T02:27:32.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T02:27:32.410 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1