2024-04-19T00:47:00.295 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-19T00:47:00.295 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-19T00:47:00.458 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f810e7adc10>, signals=[15]) 2024-04-19T00:47:00.458 INFO:teuthology.lock.ops:Start node 'smithi008.front.sepia.ceph.com' reimaging 2024-04-19T00:47:00.459 INFO:teuthology.lock.ops:Updating [smithi008.front.sepia.ceph.com]: reset os type and version on server 2024-04-19T00:47:00.459 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server 2024-04-19T00:47:00.488 INFO:teuthology.lock.ops:Start node 'smithi057.front.sepia.ceph.com' reimaging 2024-04-19T00:47:00.488 INFO:teuthology.lock.ops:Updating [smithi057.front.sepia.ceph.com]: reset os type and version on server 2024-04-19T00:47:00.488 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server 2024-04-19T00:47:00.504 INFO:teuthology.lock.ops:Start node 'smithi077.front.sepia.ceph.com' reimaging 2024-04-19T00:47:00.504 INFO:teuthology.lock.ops:Updating [smithi077.front.sepia.ceph.com]: reset os type and version on server 2024-04-19T00:47:00.504 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server 2024-04-19T00:47:00.598 DEBUG:teuthology.provision.fog.smithi008:Requesting image smithi_centos_9.stream (ID 10) 2024-04-19T00:47:00.608 DEBUG:teuthology.provision.fog.smithi057:Requesting image smithi_centos_9.stream (ID 10) 2024-04-19T00:47:00.635 DEBUG:teuthology.provision.fog.smithi077:Requesting image smithi_centos_9.stream (ID 10) 2024-04-19T00:47:00.644 INFO:teuthology.provision.fog.smithi008:Scheduling deploy of centos 9.stream 2024-04-19T00:47:00.660 INFO:teuthology.provision.fog.smithi057:Scheduling deploy of centos 9.stream 2024-04-19T00:47:00.681 INFO:teuthology.provision.fog.smithi077:Scheduling deploy of centos 9.stream 2024-04-19T00:47:00.909 INFO:teuthology.orchestra.console.smithi008:Power off 2024-04-19T00:47:00.909 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-19T00:47:00.924 INFO:teuthology.orchestra.console.smithi077:Power off 2024-04-19T00:47:00.924 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-19T00:47:00.934 INFO:teuthology.orchestra.console.smithi057:Power off 2024-04-19T00:47:00.934 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-19T00:47:00.941 DEBUG:teuthology.orchestra.console.smithi008:power off output: Chassis Power Control: Down/Off 2024-04-19T00:47:00.941 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T00:47:00.949 DEBUG:teuthology.orchestra.console.smithi077:power off output: Chassis Power Control: Down/Off 2024-04-19T00:47:00.950 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T00:47:00.957 DEBUG:teuthology.orchestra.console.smithi057:power off output: Chassis Power Control: Down/Off 2024-04-19T00:47:00.957 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T00:47:00.965 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is on 2024-04-19T00:47:00.970 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is on 2024-04-19T00:47:00.979 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is on 2024-04-19T00:47:04.970 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T00:47:04.977 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T00:47:04.984 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T00:47:05.079 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is on 2024-04-19T00:47:05.086 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is on 2024-04-19T00:47:05.092 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is on 2024-04-19T00:47:09.084 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T00:47:09.092 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T00:47:09.098 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T00:47:09.194 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is on 2024-04-19T00:47:09.200 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is off 2024-04-19T00:47:09.206 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off 2024-04-19T00:47:09.301 INFO:teuthology.orchestra.console.smithi077:Power off completed 2024-04-19T00:47:09.307 INFO:teuthology.orchestra.console.smithi057:Power off completed 2024-04-19T00:47:09.402 INFO:teuthology.orchestra.console.smithi077:Power on 2024-04-19T00:47:09.402 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-19T00:47:09.410 INFO:teuthology.orchestra.console.smithi057:Power on 2024-04-19T00:47:09.410 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-19T00:47:09.424 DEBUG:teuthology.orchestra.console.smithi077:power on output: Chassis Power Control: Up/On 2024-04-19T00:47:09.425 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T00:47:09.433 DEBUG:teuthology.orchestra.console.smithi057:power on output: Chassis Power Control: Up/On 2024-04-19T00:47:09.434 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T00:47:09.446 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is off 2024-04-19T00:47:09.455 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off 2024-04-19T00:47:13.197 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T00:47:13.306 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is off 2024-04-19T00:47:13.407 INFO:teuthology.orchestra.console.smithi008:Power off completed 2024-04-19T00:47:13.447 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T00:47:13.456 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T00:47:13.507 INFO:teuthology.orchestra.console.smithi008:Power on 2024-04-19T00:47:13.508 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-19T00:47:13.530 DEBUG:teuthology.orchestra.console.smithi008:power on output: Chassis Power Control: Up/On 2024-04-19T00:47:13.530 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T00:47:13.551 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is off 2024-04-19T00:47:13.556 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is on 2024-04-19T00:47:13.566 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off 2024-04-19T00:47:13.658 INFO:teuthology.orchestra.console.smithi077:Power on completed 2024-04-19T00:47:13.758 INFO:teuthology.provision.fog.smithi077:Waiting for deploy to finish 2024-04-19T00:47:17.556 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T00:47:17.567 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T00:47:17.665 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is on 2024-04-19T00:47:17.675 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is on 2024-04-19T00:47:17.766 INFO:teuthology.orchestra.console.smithi008:Power on completed 2024-04-19T00:47:17.776 INFO:teuthology.orchestra.console.smithi057:Power on completed 2024-04-19T00:47:17.867 INFO:teuthology.provision.fog.smithi008:Waiting for deploy to finish 2024-04-19T00:47:17.876 INFO:teuthology.provision.fog.smithi057:Waiting for deploy to finish 2024-04-19T00:49:44.537 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T00:49:48.586 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T00:49:48.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T00:49:48.710 ERROR:teuthology.orchestra.connection:Error authenticating with smithi057.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-04-19T00:50:02.910 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77 2024-04-19T00:50:07.006 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2024-04-19T00:50:08.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T00:50:11.966 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77 2024-04-19T00:50:13.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T00:50:16.062 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2024-04-19T00:50:17.968 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T00:50:21.022 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77 2024-04-19T00:50:22.063 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T00:50:25.118 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2024-04-19T00:50:27.024 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T00:50:30.078 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77 2024-04-19T00:50:31.120 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T00:50:34.174 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2024-04-19T00:50:36.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T00:50:39.138 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77 2024-04-19T00:50:40.176 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T00:50:43.230 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2024-04-19T00:50:45.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T00:50:49.232 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T00:50:52.714 WARNING:teuthology.provision.fog.smithi057:timed out 2024-04-19T00:50:58.715 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T00:51:17.150 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2024-04-19T00:51:23.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T00:51:26.210 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2024-04-19T00:51:32.212 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T00:51:35.262 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2024-04-19T00:51:41.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T00:51:41.552 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-19T00:51:41.553 DEBUG:teuthology.orchestra.run.smithi057:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-19T00:51:45.143 WARNING:teuthology.provision.fog.smithi077:timed out 2024-04-19T00:51:49.234 WARNING:teuthology.provision.fog.smithi008:timed out 2024-04-19T00:51:51.144 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T00:51:51.364 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-19T00:51:51.365 DEBUG:teuthology.orchestra.run.smithi077:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-19T00:51:51.686 INFO:teuthology.provision.fog.smithi077:Node is ready 2024-04-19T00:51:51.686 DEBUG:teuthology.orchestra.run.smithi077:> hostname 2024-04-19T00:51:51.700 INFO:teuthology.orchestra.run.smithi077.stdout:smithi077.front.sepia.ceph.com 2024-04-19T00:51:51.701 DEBUG:teuthology.orchestra.run.smithi077:> grep smithi077.front.sepia.ceph.com /etc/hosts 2024-04-19T00:51:51.756 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77 smithi077.front.sepia.ceph.com smithi077 2024-04-19T00:51:51.756 DEBUG:teuthology.orchestra.run.smithi077:> sudo hostname smithi077 2024-04-19T00:51:51.864 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i -e 's/smithi077.front.sepia.ceph.com/smithi077/g' /etc/hosts 2024-04-19T00:51:51.891 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i -e 's/172.21.15.77/172.21.15.77/g' /etc/hosts 2024-04-19T00:51:51.958 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i -e 's/smithi077.front.sepia.ceph.com/smithi077/g' /etc/hostname 2024-04-19T00:51:52.026 DEBUG:teuthology.orchestra.run.smithi077:> sudo hostname smithi077 2024-04-19T00:51:52.093 DEBUG:teuthology.orchestra.run.smithi077:> cat /etc/os-release 2024-04-19T00:51:52.147 INFO:teuthology.orchestra.run.smithi077.stdout:NAME="CentOS Stream" 2024-04-19T00:51:52.147 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION="9" 2024-04-19T00:51:52.147 INFO:teuthology.orchestra.run.smithi077.stdout:ID="centos" 2024-04-19T00:51:52.148 INFO:teuthology.orchestra.run.smithi077.stdout:ID_LIKE="rhel fedora" 2024-04-19T00:51:52.148 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_ID="9" 2024-04-19T00:51:52.148 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM_ID="platform:el9" 2024-04-19T00:51:52.148 INFO:teuthology.orchestra.run.smithi077.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-19T00:51:52.148 INFO:teuthology.orchestra.run.smithi077.stdout:ANSI_COLOR="0;31" 2024-04-19T00:51:52.148 INFO:teuthology.orchestra.run.smithi077.stdout:LOGO="fedora-logo-icon" 2024-04-19T00:51:52.148 INFO:teuthology.orchestra.run.smithi077.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-19T00:51:52.148 INFO:teuthology.orchestra.run.smithi077.stdout:HOME_URL="https://centos.org/" 2024-04-19T00:51:52.148 INFO:teuthology.orchestra.run.smithi077.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-19T00:51:52.148 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-19T00:51:52.148 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-19T00:51:52.149 INFO:teuthology.provision.fog.smithi077:Deploy complete! 2024-04-19T00:51:52.150 DEBUG:teuthology.parallel:result is None 2024-04-19T00:51:55.235 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T00:51:55.504 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-19T00:51:55.504 DEBUG:teuthology.orchestra.run.smithi008:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-19T00:51:55.856 INFO:teuthology.provision.fog.smithi008:Node is ready 2024-04-19T00:51:55.856 DEBUG:teuthology.orchestra.run.smithi008:> hostname 2024-04-19T00:51:55.872 INFO:teuthology.orchestra.run.smithi008.stdout:smithi008.front.sepia.ceph.com 2024-04-19T00:51:55.872 DEBUG:teuthology.orchestra.run.smithi008:> grep smithi008.front.sepia.ceph.com /etc/hosts 2024-04-19T00:51:55.929 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8 smithi008.front.sepia.ceph.com smithi008 2024-04-19T00:51:55.929 DEBUG:teuthology.orchestra.run.smithi008:> sudo hostname smithi008 2024-04-19T00:51:56.041 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i -e 's/smithi008.front.sepia.ceph.com/smithi008/g' /etc/hosts 2024-04-19T00:51:56.074 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i -e 's/172.21.15.8/172.21.15.8/g' /etc/hosts 2024-04-19T00:51:56.147 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i -e 's/smithi008.front.sepia.ceph.com/smithi008/g' /etc/hostname 2024-04-19T00:51:56.173 INFO:teuthology.provision.fog.smithi057:Node is ready 2024-04-19T00:51:56.173 DEBUG:teuthology.orchestra.run.smithi057:> hostname 2024-04-19T00:51:56.192 INFO:teuthology.orchestra.run.smithi057.stdout:smithi057.front.sepia.ceph.com 2024-04-19T00:51:56.192 DEBUG:teuthology.orchestra.run.smithi057:> grep smithi057.front.sepia.ceph.com /etc/hosts 2024-04-19T00:51:56.220 DEBUG:teuthology.orchestra.run.smithi008:> sudo hostname smithi008 2024-04-19T00:51:56.251 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57 smithi057.front.sepia.ceph.com smithi057 2024-04-19T00:51:56.251 DEBUG:teuthology.orchestra.run.smithi057:> sudo hostname smithi057 2024-04-19T00:51:56.290 DEBUG:teuthology.orchestra.run.smithi008:> cat /etc/os-release 2024-04-19T00:51:56.346 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="CentOS Stream" 2024-04-19T00:51:56.347 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="9" 2024-04-19T00:51:56.347 INFO:teuthology.orchestra.run.smithi008.stdout:ID="centos" 2024-04-19T00:51:56.347 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE="rhel fedora" 2024-04-19T00:51:56.347 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="9" 2024-04-19T00:51:56.347 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM_ID="platform:el9" 2024-04-19T00:51:56.347 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-19T00:51:56.347 INFO:teuthology.orchestra.run.smithi008.stdout:ANSI_COLOR="0;31" 2024-04-19T00:51:56.348 INFO:teuthology.orchestra.run.smithi008.stdout:LOGO="fedora-logo-icon" 2024-04-19T00:51:56.348 INFO:teuthology.orchestra.run.smithi008.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-19T00:51:56.348 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://centos.org/" 2024-04-19T00:51:56.348 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-19T00:51:56.348 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-19T00:51:56.348 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-19T00:51:56.349 INFO:teuthology.provision.fog.smithi008:Deploy complete! 2024-04-19T00:51:56.350 DEBUG:teuthology.parallel:result is None 2024-04-19T00:51:56.391 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/smithi057.front.sepia.ceph.com/smithi057/g' /etc/hosts 2024-04-19T00:51:56.426 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/172.21.15.57/172.21.15.57/g' /etc/hosts 2024-04-19T00:51:56.501 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/smithi057.front.sepia.ceph.com/smithi057/g' /etc/hostname 2024-04-19T00:51:56.575 DEBUG:teuthology.orchestra.run.smithi057:> sudo hostname smithi057 2024-04-19T00:51:56.647 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release 2024-04-19T00:51:56.703 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="CentOS Stream" 2024-04-19T00:51:56.703 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="9" 2024-04-19T00:51:56.703 INFO:teuthology.orchestra.run.smithi057.stdout:ID="centos" 2024-04-19T00:51:56.703 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE="rhel fedora" 2024-04-19T00:51:56.703 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="9" 2024-04-19T00:51:56.704 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM_ID="platform:el9" 2024-04-19T00:51:56.704 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-19T00:51:56.704 INFO:teuthology.orchestra.run.smithi057.stdout:ANSI_COLOR="0;31" 2024-04-19T00:51:56.704 INFO:teuthology.orchestra.run.smithi057.stdout:LOGO="fedora-logo-icon" 2024-04-19T00:51:56.704 INFO:teuthology.orchestra.run.smithi057.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-19T00:51:56.704 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://centos.org/" 2024-04-19T00:51:56.704 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-19T00:51:56.705 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-19T00:51:56.705 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-19T00:51:56.705 INFO:teuthology.provision.fog.smithi057:Deploy complete! 2024-04-19T00:51:56.706 DEBUG:teuthology.parallel:result is None 2024-04-19T00:51:56.960 INFO:teuthology.lock.ops:Checking smithi008.front.sepia.ceph.com 2024-04-19T00:51:56.961 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-19T00:51:57.053 INFO:teuthology.lock.ops:Checking smithi057.front.sepia.ceph.com 2024-04-19T00:51:57.053 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-19T00:51:57.069 INFO:teuthology.lock.ops:Checking smithi077.front.sepia.ceph.com 2024-04-19T00:51:57.069 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-19T00:51:57.087 INFO:teuthology.lock.ops:Updating [smithi008.front.sepia.ceph.com]: set os type and version on server 2024-04-19T00:51:57.087 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2024-04-19T00:51:57.088 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T00:51:57.192 DEBUG:teuthology.orchestra.run.smithi008:> true 2024-04-19T00:51:57.262 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi008.front.sepia.ceph.com' 2024-04-19T00:51:57.263 DEBUG:teuthology.orchestra.run.smithi008:> uname -m 2024-04-19T00:51:57.319 INFO:teuthology.orchestra.run.smithi008.stdout:x86_64 2024-04-19T00:51:57.320 DEBUG:teuthology.orchestra.run.smithi008:> cat /etc/os-release 2024-04-19T00:51:57.378 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="CentOS Stream" 2024-04-19T00:51:57.378 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="9" 2024-04-19T00:51:57.378 INFO:teuthology.orchestra.run.smithi008.stdout:ID="centos" 2024-04-19T00:51:57.378 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE="rhel fedora" 2024-04-19T00:51:57.378 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="9" 2024-04-19T00:51:57.378 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM_ID="platform:el9" 2024-04-19T00:51:57.378 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-19T00:51:57.378 INFO:teuthology.orchestra.run.smithi008.stdout:ANSI_COLOR="0;31" 2024-04-19T00:51:57.378 INFO:teuthology.orchestra.run.smithi008.stdout:LOGO="fedora-logo-icon" 2024-04-19T00:51:57.378 INFO:teuthology.orchestra.run.smithi008.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-19T00:51:57.378 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://centos.org/" 2024-04-19T00:51:57.379 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-19T00:51:57.379 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-19T00:51:57.379 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-19T00:51:57.379 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server 2024-04-19T00:51:57.403 INFO:teuthology.lock.ops:Updating [smithi057.front.sepia.ceph.com]: set os type and version on server 2024-04-19T00:51:57.403 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-04-19T00:51:57.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T00:51:57.503 DEBUG:teuthology.orchestra.run.smithi057:> true 2024-04-19T00:51:57.579 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-04-19T00:51:57.579 DEBUG:teuthology.orchestra.run.smithi057:> uname -m 2024-04-19T00:51:57.637 INFO:teuthology.orchestra.run.smithi057.stdout:x86_64 2024-04-19T00:51:57.637 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release 2024-04-19T00:51:57.695 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="CentOS Stream" 2024-04-19T00:51:57.695 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="9" 2024-04-19T00:51:57.695 INFO:teuthology.orchestra.run.smithi057.stdout:ID="centos" 2024-04-19T00:51:57.695 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE="rhel fedora" 2024-04-19T00:51:57.695 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="9" 2024-04-19T00:51:57.695 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM_ID="platform:el9" 2024-04-19T00:51:57.695 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-19T00:51:57.695 INFO:teuthology.orchestra.run.smithi057.stdout:ANSI_COLOR="0;31" 2024-04-19T00:51:57.695 INFO:teuthology.orchestra.run.smithi057.stdout:LOGO="fedora-logo-icon" 2024-04-19T00:51:57.695 INFO:teuthology.orchestra.run.smithi057.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-19T00:51:57.695 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://centos.org/" 2024-04-19T00:51:57.695 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-19T00:51:57.696 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-19T00:51:57.696 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-19T00:51:57.696 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server 2024-04-19T00:51:57.720 INFO:teuthology.lock.ops:Updating [smithi077.front.sepia.ceph.com]: set os type and version on server 2024-04-19T00:51:57.720 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-04-19T00:51:57.720 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T00:51:57.806 DEBUG:teuthology.orchestra.run.smithi077:> true 2024-04-19T00:51:57.874 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-04-19T00:51:57.903 DEBUG:teuthology.orchestra.run.smithi077:> uname -m 2024-04-19T00:51:57.934 INFO:teuthology.orchestra.run.smithi077.stdout:x86_64 2024-04-19T00:51:57.934 DEBUG:teuthology.orchestra.run.smithi077:> cat /etc/os-release 2024-04-19T00:51:57.994 INFO:teuthology.orchestra.run.smithi077.stdout:NAME="CentOS Stream" 2024-04-19T00:51:57.994 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION="9" 2024-04-19T00:51:57.994 INFO:teuthology.orchestra.run.smithi077.stdout:ID="centos" 2024-04-19T00:51:57.994 INFO:teuthology.orchestra.run.smithi077.stdout:ID_LIKE="rhel fedora" 2024-04-19T00:51:57.994 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_ID="9" 2024-04-19T00:51:57.994 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM_ID="platform:el9" 2024-04-19T00:51:57.994 INFO:teuthology.orchestra.run.smithi077.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-19T00:51:57.994 INFO:teuthology.orchestra.run.smithi077.stdout:ANSI_COLOR="0;31" 2024-04-19T00:51:57.995 INFO:teuthology.orchestra.run.smithi077.stdout:LOGO="fedora-logo-icon" 2024-04-19T00:51:57.995 INFO:teuthology.orchestra.run.smithi077.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-19T00:51:57.995 INFO:teuthology.orchestra.run.smithi077.stdout:HOME_URL="https://centos.org/" 2024-04-19T00:51:57.995 INFO:teuthology.orchestra.run.smithi077.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-19T00:51:57.995 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-19T00:51:57.995 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-19T00:51:57.995 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server 2024-04-19T00:51:58.019 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-19T00:51:58.123 INFO:teuthology.dispatcher.supervisor:Running job 7663227 2024-04-19T00:51:58.123 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-04-18_22:49:05-rados-wip-yuri5-testing-2024-04-17-1400-distro-default-smithi/7663227 --name yuriw-2024-04-18_22:49:05-rados-wip-yuri5-testing-2024-04-17-1400-distro-default-smithi --description rados/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_host_drain} -- /home/teuthworker/archive/yuriw-2024-04-18_22:49:05-rados-wip-yuri5-testing-2024-04-17-1400-distro-default-smithi/7663227/orig.config.yaml 2024-04-19T00:51:58.127 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-04-18_22:49:05-rados-wip-yuri5-testing-2024-04-17-1400-distro-default-smithi/7663227 2024-04-19T00:51:58.127 INFO:teuthology.dispatcher.supervisor:Job PID: 2700644 2024-04-19T00:51:58.127 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-19T00:53:58.129 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-19T00:55:58.204 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-19T00:57:58.277 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-19T00:59:58.342 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-19T00:59:58.410 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1