2024-03-25T23:47:52.320 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-25T23:47:52.320 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-25T23:47:52.500 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6b87a2ac10>, signals=[15]) 2024-03-25T23:47:52.500 INFO:teuthology.lock.ops:Start node 'smithi012.front.sepia.ceph.com' reimaging 2024-03-25T23:47:52.501 INFO:teuthology.lock.ops:Updating [smithi012.front.sepia.ceph.com]: reset os type and version on server 2024-03-25T23:47:52.501 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server 2024-03-25T23:47:52.521 INFO:teuthology.lock.ops:Start node 'smithi092.front.sepia.ceph.com' reimaging 2024-03-25T23:47:52.521 INFO:teuthology.lock.ops:Updating [smithi092.front.sepia.ceph.com]: reset os type and version on server 2024-03-25T23:47:52.521 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server 2024-03-25T23:47:52.546 INFO:teuthology.lock.ops:Start node 'smithi194.front.sepia.ceph.com' reimaging 2024-03-25T23:47:52.546 INFO:teuthology.lock.ops:Updating [smithi194.front.sepia.ceph.com]: reset os type and version on server 2024-03-25T23:47:52.546 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2024-03-25T23:47:52.644 DEBUG:teuthology.provision.fog.smithi012:Requesting image smithi_centos_9.stream (ID 10) 2024-03-25T23:47:52.662 DEBUG:teuthology.provision.fog.smithi092:Requesting image smithi_centos_9.stream (ID 10) 2024-03-25T23:47:52.688 DEBUG:teuthology.provision.fog.smithi194:Requesting image smithi_centos_9.stream (ID 10) 2024-03-25T23:47:52.694 INFO:teuthology.provision.fog.smithi012:Scheduling deploy of centos 9.stream 2024-03-25T23:47:52.702 INFO:teuthology.provision.fog.smithi092:Scheduling deploy of centos 9.stream 2024-03-25T23:47:52.740 INFO:teuthology.provision.fog.smithi194:Scheduling deploy of centos 9.stream 2024-03-25T23:47:52.987 INFO:teuthology.orchestra.console.smithi092:Power off 2024-03-25T23:47:52.987 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-25T23:47:53.002 INFO:teuthology.orchestra.console.smithi012:Power off 2024-03-25T23:47:53.002 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-25T23:47:53.014 DEBUG:teuthology.orchestra.console.smithi092:power off output: Chassis Power Control: Down/Off 2024-03-25T23:47:53.014 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T23:47:53.025 DEBUG:teuthology.orchestra.console.smithi012:power off output: Chassis Power Control: Down/Off 2024-03-25T23:47:53.025 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T23:47:53.040 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is on 2024-03-25T23:47:53.045 INFO:teuthology.orchestra.console.smithi194:Power off 2024-03-25T23:47:53.045 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-25T23:47:53.053 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on 2024-03-25T23:47:53.067 DEBUG:teuthology.orchestra.console.smithi194:power off output: Chassis Power Control: Down/Off 2024-03-25T23:47:53.067 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T23:47:53.091 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on 2024-03-25T23:47:57.045 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T23:47:57.054 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T23:47:57.092 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T23:47:57.156 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is on 2024-03-25T23:47:57.163 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on 2024-03-25T23:47:57.201 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on 2024-03-25T23:48:01.158 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T23:48:01.165 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T23:48:01.202 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T23:48:01.267 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is on 2024-03-25T23:48:01.273 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is off 2024-03-25T23:48:01.311 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on 2024-03-25T23:48:01.374 INFO:teuthology.orchestra.console.smithi012:Power off completed 2024-03-25T23:48:01.475 INFO:teuthology.orchestra.console.smithi012:Power on 2024-03-25T23:48:01.475 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-25T23:48:01.497 DEBUG:teuthology.orchestra.console.smithi012:power on output: Chassis Power Control: Up/On 2024-03-25T23:48:01.498 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T23:48:01.520 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is off 2024-03-25T23:48:05.271 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T23:48:05.311 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T23:48:05.381 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is off 2024-03-25T23:48:05.421 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2024-03-25T23:48:05.482 INFO:teuthology.orchestra.console.smithi092:Power off completed 2024-03-25T23:48:05.521 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T23:48:05.528 INFO:teuthology.orchestra.console.smithi194:Power off completed 2024-03-25T23:48:05.583 INFO:teuthology.orchestra.console.smithi092:Power on 2024-03-25T23:48:05.583 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-25T23:48:05.605 DEBUG:teuthology.orchestra.console.smithi092:power on output: Chassis Power Control: Up/On 2024-03-25T23:48:05.606 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T23:48:05.629 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is off 2024-03-25T23:48:05.629 INFO:teuthology.orchestra.console.smithi194:Power on 2024-03-25T23:48:05.629 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-25T23:48:05.637 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is off 2024-03-25T23:48:05.651 DEBUG:teuthology.orchestra.console.smithi194:power on output: Chassis Power Control: Up/On 2024-03-25T23:48:05.651 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T23:48:05.674 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2024-03-25T23:48:09.630 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T23:48:09.638 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T23:48:09.675 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T23:48:09.740 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is off 2024-03-25T23:48:09.786 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on 2024-03-25T23:48:09.827 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on 2024-03-25T23:48:09.887 INFO:teuthology.orchestra.console.smithi194:Power on completed 2024-03-25T23:48:09.928 INFO:teuthology.orchestra.console.smithi012:Power on completed 2024-03-25T23:48:09.989 INFO:teuthology.provision.fog.smithi194:Waiting for deploy to finish 2024-03-25T23:48:10.029 INFO:teuthology.provision.fog.smithi012:Waiting for deploy to finish 2024-03-25T23:48:13.742 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T23:48:13.851 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is on 2024-03-25T23:48:13.952 INFO:teuthology.orchestra.console.smithi092:Power on completed 2024-03-25T23:48:14.052 INFO:teuthology.provision.fog.smithi092:Waiting for deploy to finish 2024-03-25T23:50:25.809 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T23:50:28.866 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2024-03-25T23:50:34.873 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T23:50:37.950 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2024-03-25T23:50:40.866 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T23:50:43.934 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-03-25T23:50:43.952 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T23:50:44.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T23:50:47.006 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2024-03-25T23:50:47.902 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2024-03-25T23:50:49.938 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T23:50:52.994 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-03-25T23:50:53.007 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T23:50:53.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T23:50:56.066 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2024-03-25T23:50:56.962 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2024-03-25T23:50:58.997 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T23:51:02.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T23:51:02.078 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-03-25T23:51:02.965 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T23:51:05.150 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2024-03-25T23:51:06.050 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2024-03-25T23:51:08.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T23:51:11.138 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-03-25T23:51:11.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T23:51:12.053 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T23:51:15.134 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2024-03-25T23:51:17.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T23:51:20.222 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-03-25T23:51:21.136 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T23:51:24.194 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2024-03-25T23:51:26.225 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T23:51:29.278 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-03-25T23:51:30.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T23:51:33.278 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2024-03-25T23:51:35.281 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T23:51:38.334 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-03-25T23:51:39.279 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T23:51:42.334 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2024-03-25T23:51:44.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T23:51:48.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T23:51:51.390 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2024-03-25T23:51:57.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T23:52:00.450 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2024-03-25T23:52:06.455 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T23:52:09.534 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2024-03-25T23:52:11.154 WARNING:teuthology.provision.fog.smithi012:timed out 2024-03-25T23:52:15.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T23:52:17.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T23:52:17.446 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-25T23:52:17.447 DEBUG:teuthology.orchestra.run.smithi012:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-25T23:52:17.801 INFO:teuthology.provision.fog.smithi012:Node is ready 2024-03-25T23:52:17.801 DEBUG:teuthology.orchestra.run.smithi012:> hostname 2024-03-25T23:52:17.817 INFO:teuthology.orchestra.run.smithi012.stdout:smithi012.front.sepia.ceph.com 2024-03-25T23:52:17.817 DEBUG:teuthology.orchestra.run.smithi012:> grep smithi012.front.sepia.ceph.com /etc/hosts 2024-03-25T23:52:17.873 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12 smithi012.front.sepia.ceph.com smithi012 2024-03-25T23:52:17.873 DEBUG:teuthology.orchestra.run.smithi012:> sudo hostname smithi012 2024-03-25T23:52:17.977 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i -e 's/smithi012.front.sepia.ceph.com/smithi012/g' /etc/hosts 2024-03-25T23:52:18.009 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i -e 's/172.21.15.12/172.21.15.12/g' /etc/hosts 2024-03-25T23:52:18.082 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i -e 's/smithi012.front.sepia.ceph.com/smithi012/g' /etc/hostname 2024-03-25T23:52:18.153 DEBUG:teuthology.orchestra.run.smithi012:> sudo hostname smithi012 2024-03-25T23:52:18.224 DEBUG:teuthology.orchestra.run.smithi012:> cat /etc/os-release 2024-03-25T23:52:18.279 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="CentOS Stream" 2024-03-25T23:52:18.279 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="9" 2024-03-25T23:52:18.279 INFO:teuthology.orchestra.run.smithi012.stdout:ID="centos" 2024-03-25T23:52:18.279 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE="rhel fedora" 2024-03-25T23:52:18.279 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="9" 2024-03-25T23:52:18.279 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM_ID="platform:el9" 2024-03-25T23:52:18.279 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-25T23:52:18.279 INFO:teuthology.orchestra.run.smithi012.stdout:ANSI_COLOR="0;31" 2024-03-25T23:52:18.279 INFO:teuthology.orchestra.run.smithi012.stdout:LOGO="fedora-logo-icon" 2024-03-25T23:52:18.280 INFO:teuthology.orchestra.run.smithi012.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-25T23:52:18.280 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://centos.org/" 2024-03-25T23:52:18.280 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-25T23:52:18.280 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-25T23:52:18.280 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-25T23:52:18.280 INFO:teuthology.provision.fog.smithi012:Deploy complete! 2024-03-25T23:52:18.282 DEBUG:teuthology.parallel:result is None 2024-03-25T23:52:18.590 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2024-03-25T23:52:24.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T23:52:44.358 WARNING:teuthology.provision.fog.smithi194:timed out 2024-03-25T23:52:50.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T23:52:50.709 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-25T23:52:50.710 DEBUG:teuthology.orchestra.run.smithi194:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-25T23:52:51.026 INFO:teuthology.provision.fog.smithi194:Node is ready 2024-03-25T23:52:51.027 DEBUG:teuthology.orchestra.run.smithi194:> hostname 2024-03-25T23:52:51.041 INFO:teuthology.orchestra.run.smithi194.stdout:smithi194.front.sepia.ceph.com 2024-03-25T23:52:51.041 DEBUG:teuthology.orchestra.run.smithi194:> grep smithi194.front.sepia.ceph.com /etc/hosts 2024-03-25T23:52:51.096 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.15.194 smithi194.front.sepia.ceph.com smithi194 2024-03-25T23:52:51.097 DEBUG:teuthology.orchestra.run.smithi194:> sudo hostname smithi194 2024-03-25T23:52:51.197 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/smithi194.front.sepia.ceph.com/smithi194/g' /etc/hosts 2024-03-25T23:52:51.225 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/172.21.15.194/172.21.15.194/g' /etc/hosts 2024-03-25T23:52:51.293 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/smithi194.front.sepia.ceph.com/smithi194/g' /etc/hostname 2024-03-25T23:52:51.359 DEBUG:teuthology.orchestra.run.smithi194:> sudo hostname smithi194 2024-03-25T23:52:51.425 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release 2024-03-25T23:52:51.480 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="CentOS Stream" 2024-03-25T23:52:51.480 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="9" 2024-03-25T23:52:51.480 INFO:teuthology.orchestra.run.smithi194.stdout:ID="centos" 2024-03-25T23:52:51.480 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="rhel fedora" 2024-03-25T23:52:51.480 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="9" 2024-03-25T23:52:51.481 INFO:teuthology.orchestra.run.smithi194.stdout:PLATFORM_ID="platform:el9" 2024-03-25T23:52:51.481 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-25T23:52:51.481 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31" 2024-03-25T23:52:51.481 INFO:teuthology.orchestra.run.smithi194.stdout:LOGO="fedora-logo-icon" 2024-03-25T23:52:51.481 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-25T23:52:51.481 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://centos.org/" 2024-03-25T23:52:51.482 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-25T23:52:51.482 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-25T23:52:51.482 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-25T23:52:51.482 INFO:teuthology.provision.fog.smithi194:Deploy complete! 2024-03-25T23:52:51.483 DEBUG:teuthology.parallel:result is None 2024-03-25T23:53:24.627 WARNING:teuthology.provision.fog.smithi092:timed out 2024-03-25T23:53:30.631 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T23:53:30.866 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-25T23:53:30.866 DEBUG:teuthology.orchestra.run.smithi092:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-25T23:53:31.185 INFO:teuthology.provision.fog.smithi092:Node is ready 2024-03-25T23:53:31.185 DEBUG:teuthology.orchestra.run.smithi092:> hostname 2024-03-25T23:53:31.200 INFO:teuthology.orchestra.run.smithi092.stdout:smithi092.front.sepia.ceph.com 2024-03-25T23:53:31.200 DEBUG:teuthology.orchestra.run.smithi092:> grep smithi092.front.sepia.ceph.com /etc/hosts 2024-03-25T23:53:31.255 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92 smithi092.front.sepia.ceph.com smithi092 2024-03-25T23:53:31.255 DEBUG:teuthology.orchestra.run.smithi092:> sudo hostname smithi092 2024-03-25T23:53:31.352 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i -e 's/smithi092.front.sepia.ceph.com/smithi092/g' /etc/hosts 2024-03-25T23:53:31.379 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i -e 's/172.21.15.92/172.21.15.92/g' /etc/hosts 2024-03-25T23:53:31.446 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i -e 's/smithi092.front.sepia.ceph.com/smithi092/g' /etc/hostname 2024-03-25T23:53:31.514 DEBUG:teuthology.orchestra.run.smithi092:> sudo hostname smithi092 2024-03-25T23:53:31.580 DEBUG:teuthology.orchestra.run.smithi092:> cat /etc/os-release 2024-03-25T23:53:31.634 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="CentOS Stream" 2024-03-25T23:53:31.634 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="9" 2024-03-25T23:53:31.634 INFO:teuthology.orchestra.run.smithi092.stdout:ID="centos" 2024-03-25T23:53:31.634 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE="rhel fedora" 2024-03-25T23:53:31.634 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="9" 2024-03-25T23:53:31.634 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM_ID="platform:el9" 2024-03-25T23:53:31.634 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-25T23:53:31.635 INFO:teuthology.orchestra.run.smithi092.stdout:ANSI_COLOR="0;31" 2024-03-25T23:53:31.635 INFO:teuthology.orchestra.run.smithi092.stdout:LOGO="fedora-logo-icon" 2024-03-25T23:53:31.635 INFO:teuthology.orchestra.run.smithi092.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-25T23:53:31.635 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://centos.org/" 2024-03-25T23:53:31.635 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-25T23:53:31.635 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-25T23:53:31.635 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-25T23:53:31.635 INFO:teuthology.provision.fog.smithi092:Deploy complete! 2024-03-25T23:53:31.636 DEBUG:teuthology.parallel:result is None 2024-03-25T23:53:31.856 INFO:teuthology.lock.ops:Checking smithi012.front.sepia.ceph.com 2024-03-25T23:53:31.856 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-25T23:53:31.875 INFO:teuthology.lock.ops:Checking smithi092.front.sepia.ceph.com 2024-03-25T23:53:31.875 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-25T23:53:31.891 INFO:teuthology.lock.ops:Checking smithi194.front.sepia.ceph.com 2024-03-25T23:53:31.891 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-25T23:53:31.910 INFO:teuthology.lock.ops:Updating [smithi012.front.sepia.ceph.com]: set os type and version on server 2024-03-25T23:53:31.910 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-03-25T23:53:31.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T23:53:32.018 DEBUG:teuthology.orchestra.run.smithi012:> true 2024-03-25T23:53:32.201 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-03-25T23:53:32.201 DEBUG:teuthology.orchestra.run.smithi012:> uname -m 2024-03-25T23:53:32.257 INFO:teuthology.orchestra.run.smithi012.stdout:x86_64 2024-03-25T23:53:32.257 DEBUG:teuthology.orchestra.run.smithi012:> cat /etc/os-release 2024-03-25T23:53:32.312 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="CentOS Stream" 2024-03-25T23:53:32.312 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="9" 2024-03-25T23:53:32.312 INFO:teuthology.orchestra.run.smithi012.stdout:ID="centos" 2024-03-25T23:53:32.312 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE="rhel fedora" 2024-03-25T23:53:32.312 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="9" 2024-03-25T23:53:32.312 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM_ID="platform:el9" 2024-03-25T23:53:32.312 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-25T23:53:32.312 INFO:teuthology.orchestra.run.smithi012.stdout:ANSI_COLOR="0;31" 2024-03-25T23:53:32.312 INFO:teuthology.orchestra.run.smithi012.stdout:LOGO="fedora-logo-icon" 2024-03-25T23:53:32.312 INFO:teuthology.orchestra.run.smithi012.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-25T23:53:32.312 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://centos.org/" 2024-03-25T23:53:32.312 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-25T23:53:32.312 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-25T23:53:32.313 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-25T23:53:32.313 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server 2024-03-25T23:53:32.334 INFO:teuthology.lock.ops:Updating [smithi092.front.sepia.ceph.com]: set os type and version on server 2024-03-25T23:53:32.334 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-03-25T23:53:32.334 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T23:53:32.422 DEBUG:teuthology.orchestra.run.smithi092:> true 2024-03-25T23:53:32.488 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-03-25T23:53:32.489 DEBUG:teuthology.orchestra.run.smithi092:> uname -m 2024-03-25T23:53:32.543 INFO:teuthology.orchestra.run.smithi092.stdout:x86_64 2024-03-25T23:53:32.543 DEBUG:teuthology.orchestra.run.smithi092:> cat /etc/os-release 2024-03-25T23:53:32.597 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="CentOS Stream" 2024-03-25T23:53:32.597 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="9" 2024-03-25T23:53:32.597 INFO:teuthology.orchestra.run.smithi092.stdout:ID="centos" 2024-03-25T23:53:32.597 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE="rhel fedora" 2024-03-25T23:53:32.598 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="9" 2024-03-25T23:53:32.598 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM_ID="platform:el9" 2024-03-25T23:53:32.598 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-25T23:53:32.598 INFO:teuthology.orchestra.run.smithi092.stdout:ANSI_COLOR="0;31" 2024-03-25T23:53:32.598 INFO:teuthology.orchestra.run.smithi092.stdout:LOGO="fedora-logo-icon" 2024-03-25T23:53:32.598 INFO:teuthology.orchestra.run.smithi092.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-25T23:53:32.598 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://centos.org/" 2024-03-25T23:53:32.598 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-25T23:53:32.598 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-25T23:53:32.598 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-25T23:53:32.599 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server 2024-03-25T23:53:32.937 INFO:teuthology.lock.ops:Updating [smithi194.front.sepia.ceph.com]: set os type and version on server 2024-03-25T23:53:32.937 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-03-25T23:53:32.938 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T23:53:33.030 DEBUG:teuthology.orchestra.run.smithi194:> true 2024-03-25T23:53:33.201 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-03-25T23:53:33.201 DEBUG:teuthology.orchestra.run.smithi194:> uname -m 2024-03-25T23:53:33.256 INFO:teuthology.orchestra.run.smithi194.stdout:x86_64 2024-03-25T23:53:33.256 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release 2024-03-25T23:53:33.311 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="CentOS Stream" 2024-03-25T23:53:33.312 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="9" 2024-03-25T23:53:33.312 INFO:teuthology.orchestra.run.smithi194.stdout:ID="centos" 2024-03-25T23:53:33.312 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="rhel fedora" 2024-03-25T23:53:33.312 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="9" 2024-03-25T23:53:33.312 INFO:teuthology.orchestra.run.smithi194.stdout:PLATFORM_ID="platform:el9" 2024-03-25T23:53:33.312 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-25T23:53:33.312 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31" 2024-03-25T23:53:33.312 INFO:teuthology.orchestra.run.smithi194.stdout:LOGO="fedora-logo-icon" 2024-03-25T23:53:33.312 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-25T23:53:33.312 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://centos.org/" 2024-03-25T23:53:33.312 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-25T23:53:33.312 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-25T23:53:33.312 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-25T23:53:33.313 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2024-03-25T23:53:33.342 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-25T23:53:33.438 INFO:teuthology.dispatcher.supervisor:Running job 7621751 2024-03-25T23:53:33.439 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-03-25_20:36:27-rados-wip-yuri3-testing-2024-03-25-0744-distro-default-smithi/7621751 --name yuriw-2024-03-25_20:36:27-rados-wip-yuri3-testing-2024-03-25-0744-distro-default-smithi --description rados/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_host_drain} -- /home/teuthworker/archive/yuriw-2024-03-25_20:36:27-rados-wip-yuri3-testing-2024-03-25-0744-distro-default-smithi/7621751/orig.config.yaml 2024-03-25T23:53:33.442 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-03-25_20:36:27-rados-wip-yuri3-testing-2024-03-25-0744-distro-default-smithi/7621751 2024-03-25T23:53:33.442 INFO:teuthology.dispatcher.supervisor:Job PID: 2839602 2024-03-25T23:53:33.442 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-25T23:55:33.543 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-25T23:57:33.727 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-25T23:59:33.894 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T00:01:34.071 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T00:03:34.247 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T00:05:34.416 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T00:07:34.588 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T00:09:34.764 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T00:11:34.935 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T00:13:35.111 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T00:15:35.283 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T00:15:35.354 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1