2024-04-04T21:53:58.401 INFO:root:teuthology version: 0.0.1.dev265+gd7d6e60 2024-04-04T21:53:58.401 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T21:53:58.563 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f42e3f04c10>, signals=[15]) 2024-04-04T21:53:58.564 INFO:teuthology.lock.ops:Start node 'smithi060.front.sepia.ceph.com' reimaging 2024-04-04T21:53:58.564 INFO:teuthology.lock.ops:Updating [smithi060.front.sepia.ceph.com]: reset os type and version on server 2024-04-04T21:53:58.564 INFO:teuthology.lock.ops:Updating smithi060.front.sepia.ceph.com on lock server 2024-04-04T21:53:58.584 INFO:teuthology.lock.ops:Start node 'smithi105.front.sepia.ceph.com' reimaging 2024-04-04T21:53:58.584 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: reset os type and version on server 2024-04-04T21:53:58.584 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2024-04-04T21:53:58.599 INFO:teuthology.lock.ops:Start node 'smithi136.front.sepia.ceph.com' reimaging 2024-04-04T21:53:58.600 INFO:teuthology.lock.ops:Updating [smithi136.front.sepia.ceph.com]: reset os type and version on server 2024-04-04T21:53:58.600 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server 2024-04-04T21:53:58.693 DEBUG:teuthology.provision.fog.smithi060:Requesting image smithi_centos_9.stream (ID 10) 2024-04-04T21:53:58.729 DEBUG:teuthology.provision.fog.smithi105:Requesting image smithi_centos_9.stream (ID 10) 2024-04-04T21:53:58.734 DEBUG:teuthology.provision.fog.smithi136:Requesting image smithi_centos_9.stream (ID 10) 2024-04-04T21:53:58.737 INFO:teuthology.provision.fog.smithi060:Scheduling deploy of centos 9.stream 2024-04-04T21:53:58.775 INFO:teuthology.provision.fog.smithi105:Scheduling deploy of centos 9.stream 2024-04-04T21:53:58.785 INFO:teuthology.provision.fog.smithi136:Scheduling deploy of centos 9.stream 2024-04-04T21:53:58.958 INFO:teuthology.orchestra.console.smithi060:Power off 2024-04-04T21:53:58.959 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-04T21:53:58.982 DEBUG:teuthology.orchestra.console.smithi060:power off output: Chassis Power Control: Down/Off 2024-04-04T21:53:58.982 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-04T21:53:58.998 INFO:teuthology.orchestra.console.smithi136:Power off 2024-04-04T21:53:58.999 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-04T21:53:59.011 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is on 2024-04-04T21:53:59.022 DEBUG:teuthology.orchestra.console.smithi136:power off output: Chassis Power Control: Down/Off 2024-04-04T21:53:59.022 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-04T21:53:59.038 INFO:teuthology.orchestra.console.smithi105:Power off 2024-04-04T21:53:59.039 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-04T21:53:59.047 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on 2024-04-04T21:53:59.060 DEBUG:teuthology.orchestra.console.smithi105:power off output: Chassis Power Control: Down/Off 2024-04-04T21:53:59.061 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-04T21:53:59.085 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on 2024-04-04T21:54:03.014 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-04T21:54:03.048 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-04T21:54:03.086 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-04T21:54:03.125 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is on 2024-04-04T21:54:03.159 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on 2024-04-04T21:54:03.196 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on 2024-04-04T21:54:07.129 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-04T21:54:07.180 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-04T21:54:07.196 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-04T21:54:07.282 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is off 2024-04-04T21:54:07.288 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on 2024-04-04T21:54:07.306 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on 2024-04-04T21:54:07.383 INFO:teuthology.orchestra.console.smithi060:Power off completed 2024-04-04T21:54:07.484 INFO:teuthology.orchestra.console.smithi060:Power on 2024-04-04T21:54:07.484 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-04T21:54:07.506 DEBUG:teuthology.orchestra.console.smithi060:power on output: Chassis Power Control: Up/On 2024-04-04T21:54:07.506 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-04T21:54:07.528 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is off 2024-04-04T21:54:11.290 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-04T21:54:11.307 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-04T21:54:11.400 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off 2024-04-04T21:54:11.415 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off 2024-04-04T21:54:11.502 INFO:teuthology.orchestra.console.smithi136:Power off completed 2024-04-04T21:54:11.516 INFO:teuthology.orchestra.console.smithi105:Power off completed 2024-04-04T21:54:11.529 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-04T21:54:11.603 INFO:teuthology.orchestra.console.smithi136:Power on 2024-04-04T21:54:11.603 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-04T21:54:11.617 INFO:teuthology.orchestra.console.smithi105:Power on 2024-04-04T21:54:11.617 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-04T21:54:11.627 DEBUG:teuthology.orchestra.console.smithi136:power on output: Chassis Power Control: Up/On 2024-04-04T21:54:11.628 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-04T21:54:11.638 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is off 2024-04-04T21:54:11.641 DEBUG:teuthology.orchestra.console.smithi105:power on output: Chassis Power Control: Up/On 2024-04-04T21:54:11.642 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-04T21:54:11.652 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off 2024-04-04T21:54:11.663 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off 2024-04-04T21:54:15.642 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-04T21:54:15.653 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-04T21:54:15.665 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-04T21:54:15.753 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is on 2024-04-04T21:54:15.763 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off 2024-04-04T21:54:15.775 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on 2024-04-04T21:54:15.853 INFO:teuthology.orchestra.console.smithi060:Power on completed 2024-04-04T21:54:15.876 INFO:teuthology.orchestra.console.smithi105:Power on completed 2024-04-04T21:54:15.954 INFO:teuthology.provision.fog.smithi060:Waiting for deploy to finish 2024-04-04T21:54:15.977 INFO:teuthology.provision.fog.smithi105:Waiting for deploy to finish 2024-04-04T21:54:19.767 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-04T21:54:19.876 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on 2024-04-04T21:54:19.976 INFO:teuthology.orchestra.console.smithi136:Power on completed 2024-04-04T21:54:20.077 INFO:teuthology.provision.fog.smithi136:Waiting for deploy to finish 2024-04-04T21:56:46.801 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T21:56:49.854 WARNING:teuthology.provision.fog.smithi060:[Errno None] Unable to connect to port 22 on 172.21.15.60 2024-04-04T21:56:50.826 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T21:56:53.886 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-04-04T21:56:55.858 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T21:56:58.910 WARNING:teuthology.provision.fog.smithi060:[Errno None] Unable to connect to port 22 on 172.21.15.60 2024-04-04T21:56:59.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T21:57:01.863 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T21:57:02.942 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-04-04T21:57:04.914 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T21:57:04.926 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2024-04-04T21:57:07.966 WARNING:teuthology.provision.fog.smithi060:[Errno None] Unable to connect to port 22 on 172.21.15.60 2024-04-04T21:57:08.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T21:57:10.930 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T21:57:11.998 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-04-04T21:57:13.969 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T21:57:13.986 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2024-04-04T21:57:17.026 WARNING:teuthology.provision.fog.smithi060:[Errno None] Unable to connect to port 22 on 172.21.15.60 2024-04-04T21:57:18.000 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T21:57:19.989 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T21:57:21.054 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-04-04T21:57:23.029 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T21:57:23.070 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2024-04-04T21:57:26.110 WARNING:teuthology.provision.fog.smithi060:[Errno None] Unable to connect to port 22 on 172.21.15.60 2024-04-04T21:57:27.056 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T21:57:29.072 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T21:57:30.110 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-04-04T21:57:32.114 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T21:57:32.130 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2024-04-04T21:57:36.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T21:57:38.134 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T21:57:39.166 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-04-04T21:57:41.214 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2024-04-04T21:57:45.171 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T21:57:47.215 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T21:57:48.222 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-04-04T21:57:50.270 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2024-04-04T21:57:54.227 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T21:57:56.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T21:58:14.819 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2024-04-04T21:58:20.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T21:58:23.902 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2024-04-04T21:58:29.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T21:58:32.119 WARNING:teuthology.provision.fog.smithi060:timed out 2024-04-04T21:58:32.990 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2024-04-04T21:58:38.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T21:58:38.468 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-04T21:58:38.468 DEBUG:teuthology.orchestra.run.smithi060:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-04T21:58:38.828 INFO:teuthology.provision.fog.smithi060:Node is ready 2024-04-04T21:58:38.828 DEBUG:teuthology.orchestra.run.smithi060:> hostname 2024-04-04T21:58:38.843 INFO:teuthology.orchestra.run.smithi060.stdout:smithi060.front.sepia.ceph.com 2024-04-04T21:58:38.844 DEBUG:teuthology.orchestra.run.smithi060:> grep smithi060.front.sepia.ceph.com /etc/hosts 2024-04-04T21:58:38.899 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60 smithi060.front.sepia.ceph.com smithi060 2024-04-04T21:58:38.900 DEBUG:teuthology.orchestra.run.smithi060:> sudo hostname smithi060 2024-04-04T21:58:38.992 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T21:58:38.999 DEBUG:teuthology.orchestra.run.smithi060:> sudo sed -i -e 's/smithi060.front.sepia.ceph.com/smithi060/g' /etc/hosts 2024-04-04T21:58:39.030 DEBUG:teuthology.orchestra.run.smithi060:> sudo sed -i -e 's/172.21.15.60/172.21.15.60/g' /etc/hosts 2024-04-04T21:58:39.128 DEBUG:teuthology.orchestra.run.smithi060:> sudo sed -i -e 's/smithi060.front.sepia.ceph.com/smithi060/g' /etc/hostname 2024-04-04T21:58:39.200 DEBUG:teuthology.orchestra.run.smithi060:> sudo hostname smithi060 2024-04-04T21:58:39.269 DEBUG:teuthology.orchestra.run.smithi060:> cat /etc/os-release 2024-04-04T21:58:39.324 INFO:teuthology.orchestra.run.smithi060.stdout:NAME="CentOS Stream" 2024-04-04T21:58:39.324 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION="9" 2024-04-04T21:58:39.324 INFO:teuthology.orchestra.run.smithi060.stdout:ID="centos" 2024-04-04T21:58:39.324 INFO:teuthology.orchestra.run.smithi060.stdout:ID_LIKE="rhel fedora" 2024-04-04T21:58:39.324 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_ID="9" 2024-04-04T21:58:39.324 INFO:teuthology.orchestra.run.smithi060.stdout:PLATFORM_ID="platform:el9" 2024-04-04T21:58:39.324 INFO:teuthology.orchestra.run.smithi060.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-04T21:58:39.324 INFO:teuthology.orchestra.run.smithi060.stdout:ANSI_COLOR="0;31" 2024-04-04T21:58:39.325 INFO:teuthology.orchestra.run.smithi060.stdout:LOGO="fedora-logo-icon" 2024-04-04T21:58:39.325 INFO:teuthology.orchestra.run.smithi060.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-04T21:58:39.325 INFO:teuthology.orchestra.run.smithi060.stdout:HOME_URL="https://centos.org/" 2024-04-04T21:58:39.325 INFO:teuthology.orchestra.run.smithi060.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-04T21:58:39.325 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-04T21:58:39.325 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-04T21:58:39.326 INFO:teuthology.provision.fog.smithi060:Deploy complete! 2024-04-04T21:58:39.327 DEBUG:teuthology.parallel:result is None 2024-04-04T21:58:39.348 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-04T21:58:39.348 DEBUG:teuthology.orchestra.run.smithi105:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-04T21:58:54.229 WARNING:teuthology.provision.fog.smithi136:timed out 2024-04-04T21:58:54.683 INFO:teuthology.provision.fog.smithi105:Node is ready 2024-04-04T21:58:54.683 DEBUG:teuthology.orchestra.run.smithi105:> hostname 2024-04-04T21:58:54.742 INFO:teuthology.orchestra.run.smithi105.stdout:smithi046 2024-04-04T21:58:54.743 DEBUG:teuthology.orchestra.run.smithi105:> grep smithi046 /etc/hosts 2024-04-04T21:58:54.800 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2024-04-04T21:58:54.801 DEBUG:teuthology.orchestra.run.smithi105:> sudo hostname smithi105 2024-04-04T21:58:54.971 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/smithi046/smithi105/g' /etc/hosts 2024-04-04T21:58:55.004 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/172.21.15.46/172.21.15.105/g' /etc/hosts 2024-04-04T21:58:55.075 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/smithi046/smithi105/g' /etc/hostname 2024-04-04T21:58:55.145 DEBUG:teuthology.orchestra.run.smithi105:> sudo hostname smithi105 2024-04-04T21:58:55.214 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release 2024-04-04T21:58:55.270 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="CentOS Stream" 2024-04-04T21:58:55.270 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="9" 2024-04-04T21:58:55.270 INFO:teuthology.orchestra.run.smithi105.stdout:ID="centos" 2024-04-04T21:58:55.270 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="rhel fedora" 2024-04-04T21:58:55.270 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="9" 2024-04-04T21:58:55.270 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el9" 2024-04-04T21:58:55.271 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-04T21:58:55.271 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31" 2024-04-04T21:58:55.271 INFO:teuthology.orchestra.run.smithi105.stdout:LOGO="fedora-logo-icon" 2024-04-04T21:58:55.271 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-04T21:58:55.271 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://centos.org/" 2024-04-04T21:58:55.271 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-04T21:58:55.271 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-04T21:58:55.271 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-04T21:58:55.271 INFO:teuthology.provision.fog.smithi105:Deploy complete! 2024-04-04T21:58:55.272 DEBUG:teuthology.parallel:result is None 2024-04-04T21:59:00.235 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T21:59:00.574 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-04T21:59:00.574 DEBUG:teuthology.orchestra.run.smithi136:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-04T21:59:00.882 INFO:teuthology.provision.fog.smithi136:Node is ready 2024-04-04T21:59:00.883 DEBUG:teuthology.orchestra.run.smithi136:> hostname 2024-04-04T21:59:00.897 INFO:teuthology.orchestra.run.smithi136.stdout:smithi136.front.sepia.ceph.com 2024-04-04T21:59:00.897 DEBUG:teuthology.orchestra.run.smithi136:> grep smithi136.front.sepia.ceph.com /etc/hosts 2024-04-04T21:59:00.952 INFO:teuthology.orchestra.run.smithi136.stdout:172.21.15.136 smithi136.front.sepia.ceph.com smithi136 2024-04-04T21:59:00.952 DEBUG:teuthology.orchestra.run.smithi136:> sudo hostname smithi136 2024-04-04T21:59:01.079 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/smithi136.front.sepia.ceph.com/smithi136/g' /etc/hosts 2024-04-04T21:59:01.106 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/172.21.15.136/172.21.15.136/g' /etc/hosts 2024-04-04T21:59:01.178 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/smithi136.front.sepia.ceph.com/smithi136/g' /etc/hostname 2024-04-04T21:59:01.249 DEBUG:teuthology.orchestra.run.smithi136:> sudo hostname smithi136 2024-04-04T21:59:01.319 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release 2024-04-04T21:59:01.377 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="CentOS Stream" 2024-04-04T21:59:01.377 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="9" 2024-04-04T21:59:01.377 INFO:teuthology.orchestra.run.smithi136.stdout:ID="centos" 2024-04-04T21:59:01.377 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE="rhel fedora" 2024-04-04T21:59:01.377 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="9" 2024-04-04T21:59:01.377 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM_ID="platform:el9" 2024-04-04T21:59:01.377 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-04T21:59:01.377 INFO:teuthology.orchestra.run.smithi136.stdout:ANSI_COLOR="0;31" 2024-04-04T21:59:01.377 INFO:teuthology.orchestra.run.smithi136.stdout:LOGO="fedora-logo-icon" 2024-04-04T21:59:01.377 INFO:teuthology.orchestra.run.smithi136.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-04T21:59:01.377 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://centos.org/" 2024-04-04T21:59:01.377 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-04T21:59:01.377 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-04T21:59:01.378 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-04T21:59:01.378 INFO:teuthology.provision.fog.smithi136:Deploy complete! 2024-04-04T21:59:01.378 DEBUG:teuthology.parallel:result is None 2024-04-04T21:59:01.596 INFO:teuthology.lock.ops:Checking smithi060.front.sepia.ceph.com 2024-04-04T21:59:01.596 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-04T21:59:01.623 INFO:teuthology.lock.ops:Checking smithi105.front.sepia.ceph.com 2024-04-04T21:59:01.624 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-04T21:59:01.640 INFO:teuthology.lock.ops:Checking smithi136.front.sepia.ceph.com 2024-04-04T21:59:01.640 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-04T21:59:01.658 INFO:teuthology.lock.ops:Updating [smithi060.front.sepia.ceph.com]: set os type and version on server 2024-04-04T21:59:01.658 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-04-04T21:59:01.659 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T21:59:01.764 DEBUG:teuthology.orchestra.run.smithi060:> true 2024-04-04T21:59:01.944 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-04-04T21:59:01.944 DEBUG:teuthology.orchestra.run.smithi060:> uname -m 2024-04-04T21:59:02.000 INFO:teuthology.orchestra.run.smithi060.stdout:x86_64 2024-04-04T21:59:02.001 DEBUG:teuthology.orchestra.run.smithi060:> cat /etc/os-release 2024-04-04T21:59:02.057 INFO:teuthology.orchestra.run.smithi060.stdout:NAME="CentOS Stream" 2024-04-04T21:59:02.057 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION="9" 2024-04-04T21:59:02.057 INFO:teuthology.orchestra.run.smithi060.stdout:ID="centos" 2024-04-04T21:59:02.057 INFO:teuthology.orchestra.run.smithi060.stdout:ID_LIKE="rhel fedora" 2024-04-04T21:59:02.057 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_ID="9" 2024-04-04T21:59:02.057 INFO:teuthology.orchestra.run.smithi060.stdout:PLATFORM_ID="platform:el9" 2024-04-04T21:59:02.058 INFO:teuthology.orchestra.run.smithi060.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-04T21:59:02.058 INFO:teuthology.orchestra.run.smithi060.stdout:ANSI_COLOR="0;31" 2024-04-04T21:59:02.058 INFO:teuthology.orchestra.run.smithi060.stdout:LOGO="fedora-logo-icon" 2024-04-04T21:59:02.058 INFO:teuthology.orchestra.run.smithi060.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-04T21:59:02.058 INFO:teuthology.orchestra.run.smithi060.stdout:HOME_URL="https://centos.org/" 2024-04-04T21:59:02.058 INFO:teuthology.orchestra.run.smithi060.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-04T21:59:02.058 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-04T21:59:02.058 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-04T21:59:02.059 INFO:teuthology.lock.ops:Updating smithi060.front.sepia.ceph.com on lock server 2024-04-04T21:59:02.099 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: set os type and version on server 2024-04-04T21:59:02.099 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com' 2024-04-04T21:59:02.099 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T21:59:02.193 DEBUG:teuthology.orchestra.run.smithi105:> true 2024-04-04T21:59:02.263 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi105.front.sepia.ceph.com' 2024-04-04T21:59:02.263 DEBUG:teuthology.orchestra.run.smithi105:> uname -m 2024-04-04T21:59:02.321 INFO:teuthology.orchestra.run.smithi105.stdout:x86_64 2024-04-04T21:59:02.321 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release 2024-04-04T21:59:02.379 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="CentOS Stream" 2024-04-04T21:59:02.379 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="9" 2024-04-04T21:59:02.379 INFO:teuthology.orchestra.run.smithi105.stdout:ID="centos" 2024-04-04T21:59:02.379 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="rhel fedora" 2024-04-04T21:59:02.379 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="9" 2024-04-04T21:59:02.379 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el9" 2024-04-04T21:59:02.379 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-04T21:59:02.380 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31" 2024-04-04T21:59:02.380 INFO:teuthology.orchestra.run.smithi105.stdout:LOGO="fedora-logo-icon" 2024-04-04T21:59:02.380 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-04T21:59:02.380 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://centos.org/" 2024-04-04T21:59:02.380 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-04T21:59:02.380 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-04T21:59:02.380 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-04T21:59:02.380 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2024-04-04T21:59:02.407 INFO:teuthology.lock.ops:Updating [smithi136.front.sepia.ceph.com]: set os type and version on server 2024-04-04T21:59:02.407 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-04-04T21:59:02.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T21:59:02.555 DEBUG:teuthology.orchestra.run.smithi136:> true 2024-04-04T21:59:02.623 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-04-04T21:59:02.624 DEBUG:teuthology.orchestra.run.smithi136:> uname -m 2024-04-04T21:59:02.684 INFO:teuthology.orchestra.run.smithi136.stdout:x86_64 2024-04-04T21:59:02.685 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release 2024-04-04T21:59:02.745 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="CentOS Stream" 2024-04-04T21:59:02.745 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="9" 2024-04-04T21:59:02.746 INFO:teuthology.orchestra.run.smithi136.stdout:ID="centos" 2024-04-04T21:59:02.746 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE="rhel fedora" 2024-04-04T21:59:02.746 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="9" 2024-04-04T21:59:02.747 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM_ID="platform:el9" 2024-04-04T21:59:02.747 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-04T21:59:02.747 INFO:teuthology.orchestra.run.smithi136.stdout:ANSI_COLOR="0;31" 2024-04-04T21:59:02.747 INFO:teuthology.orchestra.run.smithi136.stdout:LOGO="fedora-logo-icon" 2024-04-04T21:59:02.747 INFO:teuthology.orchestra.run.smithi136.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-04T21:59:02.747 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://centos.org/" 2024-04-04T21:59:02.747 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-04T21:59:02.747 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-04T21:59:02.747 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-04T21:59:02.748 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server 2024-04-04T21:59:02.774 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T21:59:03.181 INFO:teuthology.dispatcher.supervisor:Running job 7640434 2024-04-04T21:59:03.181 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_d7d6e60867cadf19fbfd7655a551ae7d58060757/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-04-04_19:42:51-rados-wip-yuri6-testing-2024-04-02-1310-distro-default-smithi/7640434 --name yuriw-2024-04-04_19:42:51-rados-wip-yuri6-testing-2024-04-02-1310-distro-default-smithi --description rados/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_host_drain} -- /home/teuthworker/archive/yuriw-2024-04-04_19:42:51-rados-wip-yuri6-testing-2024-04-02-1310-distro-default-smithi/7640434/orig.config.yaml 2024-04-04T21:59:03.185 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-04-04_19:42:51-rados-wip-yuri6-testing-2024-04-02-1310-distro-default-smithi/7640434 2024-04-04T21:59:03.186 INFO:teuthology.dispatcher.supervisor:Job PID: 1673923 2024-04-04T21:59:03.186 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-04T22:01:03.287 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T22:03:03.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T22:05:03.635 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T22:07:03.812 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T22:09:03.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T22:11:04.102 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T22:13:04.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T22:15:04.447 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T22:17:04.623 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T22:19:04.795 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T22:19:04.869 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1