2024-04-02T14:33:20.189 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-04-02T14:33:20.190 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-02T14:33:20.345 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fec350a3c10>, signals=[15]) 2024-04-02T14:33:20.346 INFO:teuthology.lock.ops:Start node 'smithi016.front.sepia.ceph.com' reimaging 2024-04-02T14:33:20.346 INFO:teuthology.lock.ops:Updating [smithi016.front.sepia.ceph.com]: reset os type and version on server 2024-04-02T14:33:20.346 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server 2024-04-02T14:33:20.369 INFO:teuthology.lock.ops:Start node 'smithi133.front.sepia.ceph.com' reimaging 2024-04-02T14:33:20.369 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: reset os type and version on server 2024-04-02T14:33:20.369 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2024-04-02T14:33:20.385 INFO:teuthology.lock.ops:Start node 'smithi138.front.sepia.ceph.com' reimaging 2024-04-02T14:33:20.385 INFO:teuthology.lock.ops:Updating [smithi138.front.sepia.ceph.com]: reset os type and version on server 2024-04-02T14:33:20.385 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server 2024-04-02T14:33:20.496 DEBUG:teuthology.provision.fog.smithi016:Requesting image smithi_centos_9.stream (ID 10) 2024-04-02T14:33:20.503 DEBUG:teuthology.provision.fog.smithi133:Requesting image smithi_centos_9.stream (ID 10) 2024-04-02T14:33:20.506 DEBUG:teuthology.provision.fog.smithi138:Requesting image smithi_centos_9.stream (ID 10) 2024-04-02T14:33:20.542 INFO:teuthology.provision.fog.smithi016:Scheduling deploy of centos 9.stream 2024-04-02T14:33:20.546 INFO:teuthology.provision.fog.smithi133:Scheduling deploy of centos 9.stream 2024-04-02T14:33:20.551 INFO:teuthology.provision.fog.smithi138:Scheduling deploy of centos 9.stream 2024-04-02T14:33:20.772 INFO:teuthology.orchestra.console.smithi016:Power off 2024-04-02T14:33:20.772 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-02T14:33:20.788 INFO:teuthology.orchestra.console.smithi138:Power off 2024-04-02T14:33:20.788 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-02T14:33:20.806 INFO:teuthology.orchestra.console.smithi133:Power off 2024-04-02T14:33:20.806 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-02T14:33:20.813 DEBUG:teuthology.orchestra.console.smithi016:power off output: Chassis Power Control: Down/Off 2024-04-02T14:33:20.813 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-02T14:33:20.821 DEBUG:teuthology.orchestra.console.smithi138:power off output: Chassis Power Control: Down/Off 2024-04-02T14:33:20.822 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-02T14:33:20.831 DEBUG:teuthology.orchestra.console.smithi133:power off output: Chassis Power Control: Down/Off 2024-04-02T14:33:20.831 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-02T14:33:20.841 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is on 2024-04-02T14:33:20.845 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off 2024-04-02T14:33:20.859 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2024-04-02T14:33:20.945 INFO:teuthology.orchestra.console.smithi138:Power off completed 2024-04-02T14:33:20.960 INFO:teuthology.orchestra.console.smithi133:Power off completed 2024-04-02T14:33:21.046 INFO:teuthology.orchestra.console.smithi138:Power on 2024-04-02T14:33:21.046 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-02T14:33:21.061 INFO:teuthology.orchestra.console.smithi133:Power on 2024-04-02T14:33:21.061 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-02T14:33:21.070 DEBUG:teuthology.orchestra.console.smithi138:power on output: Chassis Power Control: Up/On 2024-04-02T14:33:21.070 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-02T14:33:21.084 DEBUG:teuthology.orchestra.console.smithi133:power on output: Chassis Power Control: Up/On 2024-04-02T14:33:21.084 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-02T14:33:21.094 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off 2024-04-02T14:33:21.108 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2024-04-02T14:33:24.844 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-02T14:33:24.954 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is on 2024-04-02T14:33:25.095 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-02T14:33:25.109 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-02T14:33:25.205 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is on 2024-04-02T14:33:25.219 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2024-04-02T14:33:25.307 INFO:teuthology.orchestra.console.smithi138:Power on completed 2024-04-02T14:33:25.320 INFO:teuthology.orchestra.console.smithi133:Power on completed 2024-04-02T14:33:25.408 INFO:teuthology.provision.fog.smithi138:Waiting for deploy to finish 2024-04-02T14:33:25.421 INFO:teuthology.provision.fog.smithi133:Waiting for deploy to finish 2024-04-02T14:33:28.958 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-02T14:33:29.068 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is off 2024-04-02T14:33:29.168 INFO:teuthology.orchestra.console.smithi016:Power off completed 2024-04-02T14:33:29.269 INFO:teuthology.orchestra.console.smithi016:Power on 2024-04-02T14:33:29.269 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-02T14:33:29.293 DEBUG:teuthology.orchestra.console.smithi016:power on output: Chassis Power Control: Up/On 2024-04-02T14:33:29.293 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-02T14:33:29.324 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is off 2024-04-02T14:33:33.326 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-02T14:33:33.436 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is off 2024-04-02T14:33:37.438 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-02T14:33:37.548 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is on 2024-04-02T14:33:37.699 INFO:teuthology.orchestra.console.smithi016:Power on completed 2024-04-02T14:33:37.800 INFO:teuthology.provision.fog.smithi016:Waiting for deploy to finish 2024-04-02T14:35:56.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-02T14:35:56.237 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-02T14:35:59.294 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-04-02T14:35:59.295 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2024-04-02T14:36:05.299 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-02T14:36:05.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-02T14:36:08.351 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-04-02T14:36:08.386 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2024-04-02T14:36:08.738 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-02T14:36:11.806 WARNING:teuthology.provision.fog.smithi016:[Errno None] Unable to connect to port 22 on 172.21.15.16 2024-04-02T14:36:14.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-02T14:36:14.388 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-02T14:36:17.406 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-04-02T14:36:17.474 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2024-04-02T14:36:17.808 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-02T14:36:20.866 WARNING:teuthology.provision.fog.smithi016:[Errno None] Unable to connect to port 22 on 172.21.15.16 2024-04-02T14:36:23.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-02T14:36:23.476 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-02T14:36:26.462 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-04-02T14:36:26.526 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2024-04-02T14:36:26.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-02T14:36:29.922 WARNING:teuthology.provision.fog.smithi016:[Errno None] Unable to connect to port 22 on 172.21.15.16 2024-04-02T14:36:32.466 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-02T14:36:32.527 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-02T14:36:35.522 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-04-02T14:36:35.586 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2024-04-02T14:36:35.925 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-02T14:36:39.010 WARNING:teuthology.provision.fog.smithi016:[Errno None] Unable to connect to port 22 on 172.21.15.16 2024-04-02T14:36:41.526 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-02T14:36:41.587 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-02T14:36:44.606 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-04-02T14:36:44.638 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2024-04-02T14:36:45.012 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-02T14:36:48.062 WARNING:teuthology.provision.fog.smithi016:[Errno None] Unable to connect to port 22 on 172.21.15.16 2024-04-02T14:36:50.611 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-02T14:36:50.640 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-02T14:36:53.666 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-04-02T14:36:53.694 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2024-04-02T14:36:54.064 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-02T14:36:59.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-02T14:36:59.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-02T14:37:10.050 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-04-02T14:37:16.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-02T14:37:19.138 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-04-02T14:37:25.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-02T14:37:28.222 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-04-02T14:37:34.227 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-02T14:37:36.125 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-02T14:37:36.126 DEBUG:teuthology.orchestra.run.smithi133:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-02T14:37:54.067 WARNING:teuthology.provision.fog.smithi016:timed out 2024-04-02T14:37:56.465 INFO:teuthology.provision.fog.smithi133:Node is ready 2024-04-02T14:37:56.465 DEBUG:teuthology.orchestra.run.smithi133:> hostname 2024-04-02T14:37:56.485 INFO:teuthology.orchestra.run.smithi133.stdout:smithi046 2024-04-02T14:37:56.485 DEBUG:teuthology.orchestra.run.smithi133:> grep smithi046 /etc/hosts 2024-04-02T14:37:56.542 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2024-04-02T14:37:56.543 DEBUG:teuthology.orchestra.run.smithi133:> sudo hostname smithi133 2024-04-02T14:37:56.696 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/smithi046/smithi133/g' /etc/hosts 2024-04-02T14:37:56.727 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/172.21.15.46/172.21.15.133/g' /etc/hosts 2024-04-02T14:37:56.796 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/smithi046/smithi133/g' /etc/hostname 2024-04-02T14:37:56.864 DEBUG:teuthology.orchestra.run.smithi133:> sudo hostname smithi133 2024-04-02T14:37:56.932 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2024-04-02T14:37:56.987 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="CentOS Stream" 2024-04-02T14:37:56.987 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="9" 2024-04-02T14:37:56.987 INFO:teuthology.orchestra.run.smithi133.stdout:ID="centos" 2024-04-02T14:37:56.987 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE="rhel fedora" 2024-04-02T14:37:56.987 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="9" 2024-04-02T14:37:56.988 INFO:teuthology.orchestra.run.smithi133.stdout:PLATFORM_ID="platform:el9" 2024-04-02T14:37:56.988 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-02T14:37:56.988 INFO:teuthology.orchestra.run.smithi133.stdout:ANSI_COLOR="0;31" 2024-04-02T14:37:56.988 INFO:teuthology.orchestra.run.smithi133.stdout:LOGO="fedora-logo-icon" 2024-04-02T14:37:56.988 INFO:teuthology.orchestra.run.smithi133.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-02T14:37:56.988 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://centos.org/" 2024-04-02T14:37:56.988 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-02T14:37:56.988 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-02T14:37:56.988 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-02T14:37:56.989 INFO:teuthology.provision.fog.smithi133:Deploy complete! 2024-04-02T14:37:56.990 DEBUG:teuthology.parallel:result is None 2024-04-02T14:37:59.698 WARNING:teuthology.provision.fog.smithi138:timed out 2024-04-02T14:38:00.069 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-02T14:38:00.319 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-02T14:38:00.319 DEBUG:teuthology.orchestra.run.smithi016:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-02T14:38:00.667 INFO:teuthology.provision.fog.smithi016:Node is ready 2024-04-02T14:38:00.668 DEBUG:teuthology.orchestra.run.smithi016:> hostname 2024-04-02T14:38:00.682 INFO:teuthology.orchestra.run.smithi016.stdout:smithi016.front.sepia.ceph.com 2024-04-02T14:38:00.682 DEBUG:teuthology.orchestra.run.smithi016:> grep smithi016.front.sepia.ceph.com /etc/hosts 2024-04-02T14:38:00.739 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16 smithi016.front.sepia.ceph.com smithi016 2024-04-02T14:38:00.740 DEBUG:teuthology.orchestra.run.smithi016:> sudo hostname smithi016 2024-04-02T14:38:00.846 DEBUG:teuthology.orchestra.run.smithi016:> sudo sed -i -e 's/smithi016.front.sepia.ceph.com/smithi016/g' /etc/hosts 2024-04-02T14:38:00.878 DEBUG:teuthology.orchestra.run.smithi016:> sudo sed -i -e 's/172.21.15.16/172.21.15.16/g' /etc/hosts 2024-04-02T14:38:00.950 DEBUG:teuthology.orchestra.run.smithi016:> sudo sed -i -e 's/smithi016.front.sepia.ceph.com/smithi016/g' /etc/hostname 2024-04-02T14:38:01.022 DEBUG:teuthology.orchestra.run.smithi016:> sudo hostname smithi016 2024-04-02T14:38:01.093 DEBUG:teuthology.orchestra.run.smithi016:> cat /etc/os-release 2024-04-02T14:38:01.148 INFO:teuthology.orchestra.run.smithi016.stdout:NAME="CentOS Stream" 2024-04-02T14:38:01.148 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION="9" 2024-04-02T14:38:01.149 INFO:teuthology.orchestra.run.smithi016.stdout:ID="centos" 2024-04-02T14:38:01.149 INFO:teuthology.orchestra.run.smithi016.stdout:ID_LIKE="rhel fedora" 2024-04-02T14:38:01.149 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_ID="9" 2024-04-02T14:38:01.149 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM_ID="platform:el9" 2024-04-02T14:38:01.149 INFO:teuthology.orchestra.run.smithi016.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-02T14:38:01.149 INFO:teuthology.orchestra.run.smithi016.stdout:ANSI_COLOR="0;31" 2024-04-02T14:38:01.149 INFO:teuthology.orchestra.run.smithi016.stdout:LOGO="fedora-logo-icon" 2024-04-02T14:38:01.149 INFO:teuthology.orchestra.run.smithi016.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-02T14:38:01.150 INFO:teuthology.orchestra.run.smithi016.stdout:HOME_URL="https://centos.org/" 2024-04-02T14:38:01.150 INFO:teuthology.orchestra.run.smithi016.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-02T14:38:01.150 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-02T14:38:01.150 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-02T14:38:01.150 INFO:teuthology.provision.fog.smithi016:Deploy complete! 2024-04-02T14:38:01.151 DEBUG:teuthology.parallel:result is None 2024-04-02T14:38:05.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-02T14:38:06.012 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-02T14:38:06.012 DEBUG:teuthology.orchestra.run.smithi138:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-02T14:38:06.332 INFO:teuthology.provision.fog.smithi138:Node is ready 2024-04-02T14:38:06.332 DEBUG:teuthology.orchestra.run.smithi138:> hostname 2024-04-02T14:38:06.347 INFO:teuthology.orchestra.run.smithi138.stdout:smithi138.front.sepia.ceph.com 2024-04-02T14:38:06.348 DEBUG:teuthology.orchestra.run.smithi138:> grep smithi138.front.sepia.ceph.com /etc/hosts 2024-04-02T14:38:06.403 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138 smithi138.front.sepia.ceph.com smithi138 2024-04-02T14:38:06.404 DEBUG:teuthology.orchestra.run.smithi138:> sudo hostname smithi138 2024-04-02T14:38:06.507 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/smithi138.front.sepia.ceph.com/smithi138/g' /etc/hosts 2024-04-02T14:38:06.535 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/172.21.15.138/172.21.15.138/g' /etc/hosts 2024-04-02T14:38:06.603 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/smithi138.front.sepia.ceph.com/smithi138/g' /etc/hostname 2024-04-02T14:38:06.671 DEBUG:teuthology.orchestra.run.smithi138:> sudo hostname smithi138 2024-04-02T14:38:06.738 DEBUG:teuthology.orchestra.run.smithi138:> cat /etc/os-release 2024-04-02T14:38:06.793 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="CentOS Stream" 2024-04-02T14:38:06.793 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="9" 2024-04-02T14:38:06.793 INFO:teuthology.orchestra.run.smithi138.stdout:ID="centos" 2024-04-02T14:38:06.793 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE="rhel fedora" 2024-04-02T14:38:06.793 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="9" 2024-04-02T14:38:06.793 INFO:teuthology.orchestra.run.smithi138.stdout:PLATFORM_ID="platform:el9" 2024-04-02T14:38:06.793 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-02T14:38:06.794 INFO:teuthology.orchestra.run.smithi138.stdout:ANSI_COLOR="0;31" 2024-04-02T14:38:06.794 INFO:teuthology.orchestra.run.smithi138.stdout:LOGO="fedora-logo-icon" 2024-04-02T14:38:06.794 INFO:teuthology.orchestra.run.smithi138.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-02T14:38:06.794 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://centos.org/" 2024-04-02T14:38:06.794 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-02T14:38:06.794 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-02T14:38:06.794 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-02T14:38:06.794 INFO:teuthology.provision.fog.smithi138:Deploy complete! 2024-04-02T14:38:06.795 DEBUG:teuthology.parallel:result is None 2024-04-02T14:38:07.009 INFO:teuthology.lock.ops:Checking smithi016.front.sepia.ceph.com 2024-04-02T14:38:07.009 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-02T14:38:07.038 INFO:teuthology.lock.ops:Checking smithi133.front.sepia.ceph.com 2024-04-02T14:38:07.038 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-02T14:38:07.054 INFO:teuthology.lock.ops:Checking smithi138.front.sepia.ceph.com 2024-04-02T14:38:07.054 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-02T14:38:07.076 INFO:teuthology.lock.ops:Updating [smithi016.front.sepia.ceph.com]: set os type and version on server 2024-04-02T14:38:07.077 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-04-02T14:38:07.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-02T14:38:07.181 DEBUG:teuthology.orchestra.run.smithi016:> true 2024-04-02T14:38:07.251 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-04-02T14:38:07.251 DEBUG:teuthology.orchestra.run.smithi016:> uname -m 2024-04-02T14:38:07.308 INFO:teuthology.orchestra.run.smithi016.stdout:x86_64 2024-04-02T14:38:07.308 DEBUG:teuthology.orchestra.run.smithi016:> cat /etc/os-release 2024-04-02T14:38:07.365 INFO:teuthology.orchestra.run.smithi016.stdout:NAME="CentOS Stream" 2024-04-02T14:38:07.365 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION="9" 2024-04-02T14:38:07.365 INFO:teuthology.orchestra.run.smithi016.stdout:ID="centos" 2024-04-02T14:38:07.365 INFO:teuthology.orchestra.run.smithi016.stdout:ID_LIKE="rhel fedora" 2024-04-02T14:38:07.365 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_ID="9" 2024-04-02T14:38:07.365 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM_ID="platform:el9" 2024-04-02T14:38:07.365 INFO:teuthology.orchestra.run.smithi016.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-02T14:38:07.365 INFO:teuthology.orchestra.run.smithi016.stdout:ANSI_COLOR="0;31" 2024-04-02T14:38:07.365 INFO:teuthology.orchestra.run.smithi016.stdout:LOGO="fedora-logo-icon" 2024-04-02T14:38:07.366 INFO:teuthology.orchestra.run.smithi016.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-02T14:38:07.366 INFO:teuthology.orchestra.run.smithi016.stdout:HOME_URL="https://centos.org/" 2024-04-02T14:38:07.366 INFO:teuthology.orchestra.run.smithi016.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-02T14:38:07.366 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-02T14:38:07.366 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-02T14:38:07.366 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server 2024-04-02T14:38:07.397 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: set os type and version on server 2024-04-02T14:38:07.397 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-04-02T14:38:07.398 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-02T14:38:07.488 DEBUG:teuthology.orchestra.run.smithi133:> true 2024-04-02T14:38:07.657 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-04-02T14:38:07.657 DEBUG:teuthology.orchestra.run.smithi133:> uname -m 2024-04-02T14:38:07.712 INFO:teuthology.orchestra.run.smithi133.stdout:x86_64 2024-04-02T14:38:07.712 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2024-04-02T14:38:07.767 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="CentOS Stream" 2024-04-02T14:38:07.767 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="9" 2024-04-02T14:38:07.767 INFO:teuthology.orchestra.run.smithi133.stdout:ID="centos" 2024-04-02T14:38:07.767 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE="rhel fedora" 2024-04-02T14:38:07.767 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="9" 2024-04-02T14:38:07.767 INFO:teuthology.orchestra.run.smithi133.stdout:PLATFORM_ID="platform:el9" 2024-04-02T14:38:07.768 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-02T14:38:07.768 INFO:teuthology.orchestra.run.smithi133.stdout:ANSI_COLOR="0;31" 2024-04-02T14:38:07.768 INFO:teuthology.orchestra.run.smithi133.stdout:LOGO="fedora-logo-icon" 2024-04-02T14:38:07.768 INFO:teuthology.orchestra.run.smithi133.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-02T14:38:07.768 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://centos.org/" 2024-04-02T14:38:07.768 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-02T14:38:07.768 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-02T14:38:07.768 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-02T14:38:07.768 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2024-04-02T14:38:07.788 INFO:teuthology.lock.ops:Updating [smithi138.front.sepia.ceph.com]: set os type and version on server 2024-04-02T14:38:07.788 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-04-02T14:38:07.789 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-02T14:38:07.874 DEBUG:teuthology.orchestra.run.smithi138:> true 2024-04-02T14:38:07.946 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-04-02T14:38:07.947 DEBUG:teuthology.orchestra.run.smithi138:> uname -m 2024-04-02T14:38:07.999 INFO:teuthology.orchestra.run.smithi138.stdout:x86_64 2024-04-02T14:38:08.000 DEBUG:teuthology.orchestra.run.smithi138:> cat /etc/os-release 2024-04-02T14:38:08.053 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="CentOS Stream" 2024-04-02T14:38:08.053 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="9" 2024-04-02T14:38:08.053 INFO:teuthology.orchestra.run.smithi138.stdout:ID="centos" 2024-04-02T14:38:08.054 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE="rhel fedora" 2024-04-02T14:38:08.054 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="9" 2024-04-02T14:38:08.054 INFO:teuthology.orchestra.run.smithi138.stdout:PLATFORM_ID="platform:el9" 2024-04-02T14:38:08.054 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-02T14:38:08.054 INFO:teuthology.orchestra.run.smithi138.stdout:ANSI_COLOR="0;31" 2024-04-02T14:38:08.054 INFO:teuthology.orchestra.run.smithi138.stdout:LOGO="fedora-logo-icon" 2024-04-02T14:38:08.054 INFO:teuthology.orchestra.run.smithi138.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-02T14:38:08.054 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://centos.org/" 2024-04-02T14:38:08.054 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-02T14:38:08.054 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-02T14:38:08.054 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-02T14:38:08.055 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server 2024-04-02T14:38:08.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-02T14:38:08.168 INFO:teuthology.dispatcher.supervisor:Running job 7636008 2024-04-02T14:38:08.168 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_gabrioux@teuthology --archive /home/teuthworker/archive/gabrioux-2024-04-02_14:30:22-orch:cephadm-wip-guits-testing-2024-04-02-0703-distro-default-smithi/7636008 --name gabrioux-2024-04-02_14:30:22-orch:cephadm-wip-guits-testing-2024-04-02-0703-distro-default-smithi --description orch:cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_host_drain} -- /home/teuthworker/archive/gabrioux-2024-04-02_14:30:22-orch:cephadm-wip-guits-testing-2024-04-02-0703-distro-default-smithi/7636008/orig.config.yaml 2024-04-02T14:38:08.170 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/gabrioux-2024-04-02_14:30:22-orch:cephadm-wip-guits-testing-2024-04-02-0703-distro-default-smithi/7636008 2024-04-02T14:38:08.171 INFO:teuthology.dispatcher.supervisor:Job PID: 784077 2024-04-02T14:38:08.171 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-02T14:40:08.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-02T14:42:08.443 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-02T14:44:08.624 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-02T14:46:08.792 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-02T14:48:08.923 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-02T14:50:09.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-02T14:52:09.227 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-02T14:52:09.283 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1