2024-04-19T13:52:19.891 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-19T13:52:19.892 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-19T13:52:20.074 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9f9ea03c10>, signals=[15]) 2024-04-19T13:52:20.074 INFO:teuthology.lock.ops:Start node 'smithi006.front.sepia.ceph.com' reimaging 2024-04-19T13:52:20.074 INFO:teuthology.lock.ops:Updating [smithi006.front.sepia.ceph.com]: reset os type and version on server 2024-04-19T13:52:20.075 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2024-04-19T13:52:20.092 INFO:teuthology.lock.ops:Start node 'smithi007.front.sepia.ceph.com' reimaging 2024-04-19T13:52:20.092 INFO:teuthology.lock.ops:Updating [smithi007.front.sepia.ceph.com]: reset os type and version on server 2024-04-19T13:52:20.092 INFO:teuthology.lock.ops:Updating smithi007.front.sepia.ceph.com on lock server 2024-04-19T13:52:20.108 INFO:teuthology.lock.ops:Start node 'smithi104.front.sepia.ceph.com' reimaging 2024-04-19T13:52:20.109 INFO:teuthology.lock.ops:Updating [smithi104.front.sepia.ceph.com]: reset os type and version on server 2024-04-19T13:52:20.109 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server 2024-04-19T13:52:20.210 DEBUG:teuthology.provision.fog.smithi006:Requesting image smithi_centos_9.stream (ID 10) 2024-04-19T13:52:20.219 DEBUG:teuthology.provision.fog.smithi007:Requesting image smithi_centos_9.stream (ID 10) 2024-04-19T13:52:20.231 DEBUG:teuthology.provision.fog.smithi104:Requesting image smithi_centos_9.stream (ID 10) 2024-04-19T13:52:20.249 INFO:teuthology.provision.fog.smithi006:Scheduling deploy of centos 9.stream 2024-04-19T13:52:20.263 INFO:teuthology.provision.fog.smithi007:Scheduling deploy of centos 9.stream 2024-04-19T13:52:20.277 INFO:teuthology.provision.fog.smithi104:Scheduling deploy of centos 9.stream 2024-04-19T13:52:20.541 INFO:teuthology.orchestra.console.smithi007:Power off 2024-04-19T13:52:20.542 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-19T13:52:20.556 INFO:teuthology.orchestra.console.smithi104:Power off 2024-04-19T13:52:20.556 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-19T13:52:20.566 INFO:teuthology.orchestra.console.smithi006:Power off 2024-04-19T13:52:20.566 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-19T13:52:20.573 DEBUG:teuthology.orchestra.console.smithi007:power off output: Chassis Power Control: Down/Off 2024-04-19T13:52:20.574 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T13:52:20.582 DEBUG:teuthology.orchestra.console.smithi104:power off output: Chassis Power Control: Down/Off 2024-04-19T13:52:20.582 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T13:52:20.590 DEBUG:teuthology.orchestra.console.smithi006:power off output: Chassis Power Control: Down/Off 2024-04-19T13:52:20.590 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T13:52:20.600 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is off 2024-04-19T13:52:20.603 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off 2024-04-19T13:52:20.613 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is off 2024-04-19T13:52:20.702 INFO:teuthology.orchestra.console.smithi007:Power off completed 2024-04-19T13:52:20.704 INFO:teuthology.orchestra.console.smithi104:Power off completed 2024-04-19T13:52:20.713 INFO:teuthology.orchestra.console.smithi006:Power off completed 2024-04-19T13:52:20.803 INFO:teuthology.orchestra.console.smithi007:Power on 2024-04-19T13:52:20.803 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-19T13:52:20.810 INFO:teuthology.orchestra.console.smithi104:Power on 2024-04-19T13:52:20.810 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-19T13:52:20.817 INFO:teuthology.orchestra.console.smithi006:Power on 2024-04-19T13:52:20.817 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-19T13:52:20.826 DEBUG:teuthology.orchestra.console.smithi007:power on output: Chassis Power Control: Up/On 2024-04-19T13:52:20.826 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T13:52:20.835 DEBUG:teuthology.orchestra.console.smithi104:power on output: Chassis Power Control: Up/On 2024-04-19T13:52:20.835 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T13:52:20.844 DEBUG:teuthology.orchestra.console.smithi006:power on output: Chassis Power Control: Up/On 2024-04-19T13:52:20.845 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T13:52:20.852 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is off 2024-04-19T13:52:20.857 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off 2024-04-19T13:52:20.871 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is off 2024-04-19T13:52:24.857 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T13:52:24.865 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T13:52:24.872 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T13:52:24.967 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is on 2024-04-19T13:52:24.973 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off 2024-04-19T13:52:24.980 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is off 2024-04-19T13:52:25.068 INFO:teuthology.orchestra.console.smithi007:Power on completed 2024-04-19T13:52:25.169 INFO:teuthology.provision.fog.smithi007:Waiting for deploy to finish 2024-04-19T13:52:28.977 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T13:52:28.983 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T13:52:29.086 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on 2024-04-19T13:52:29.092 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is on 2024-04-19T13:52:29.187 INFO:teuthology.orchestra.console.smithi104:Power on completed 2024-04-19T13:52:29.193 INFO:teuthology.orchestra.console.smithi006:Power on completed 2024-04-19T13:52:29.287 INFO:teuthology.provision.fog.smithi104:Waiting for deploy to finish 2024-04-19T13:52:29.294 INFO:teuthology.provision.fog.smithi006:Waiting for deploy to finish 2024-04-19T13:54:56.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T13:54:59.774 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7 2024-04-19T13:55:00.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T13:55:00.663 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T13:55:03.710 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2024-04-19T13:55:03.742 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2024-04-19T13:55:05.778 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T13:55:08.834 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7 2024-04-19T13:55:09.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T13:55:09.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T13:55:12.766 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2024-04-19T13:55:12.798 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2024-04-19T13:55:14.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T13:55:17.922 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7 2024-04-19T13:55:18.767 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T13:55:18.800 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T13:55:21.822 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2024-04-19T13:55:21.854 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2024-04-19T13:55:23.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T13:55:27.006 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7 2024-04-19T13:55:27.825 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T13:55:27.855 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T13:55:30.878 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2024-04-19T13:55:30.910 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2024-04-19T13:55:33.010 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T13:55:36.066 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7 2024-04-19T13:55:36.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T13:55:36.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T13:55:39.934 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2024-04-19T13:55:39.966 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2024-04-19T13:55:42.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T13:55:45.150 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7 2024-04-19T13:55:45.937 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T13:55:45.967 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T13:55:48.990 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2024-04-19T13:55:49.022 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6 2024-04-19T13:55:51.153 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T13:55:54.996 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T13:55:55.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T13:55:58.046 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2024-04-19T13:56:04.053 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T13:56:51.199 WARNING:teuthology.provision.fog.smithi007:timed out 2024-04-19T13:56:55.029 WARNING:teuthology.provision.fog.smithi006:timed out 2024-04-19T13:56:57.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T13:56:57.459 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-19T13:56:57.460 DEBUG:teuthology.orchestra.run.smithi007:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-19T13:56:57.795 INFO:teuthology.provision.fog.smithi007:Node is ready 2024-04-19T13:56:57.796 DEBUG:teuthology.orchestra.run.smithi007:> hostname 2024-04-19T13:56:57.811 INFO:teuthology.orchestra.run.smithi007.stdout:smithi007.front.sepia.ceph.com 2024-04-19T13:56:57.811 DEBUG:teuthology.orchestra.run.smithi007:> grep smithi007.front.sepia.ceph.com /etc/hosts 2024-04-19T13:56:57.866 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7 smithi007.front.sepia.ceph.com smithi007 2024-04-19T13:56:57.867 DEBUG:teuthology.orchestra.run.smithi007:> sudo hostname smithi007 2024-04-19T13:56:57.982 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i -e 's/smithi007.front.sepia.ceph.com/smithi007/g' /etc/hosts 2024-04-19T13:56:58.013 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i -e 's/172.21.15.7/172.21.15.7/g' /etc/hosts 2024-04-19T13:56:58.083 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i -e 's/smithi007.front.sepia.ceph.com/smithi007/g' /etc/hostname 2024-04-19T13:56:58.155 DEBUG:teuthology.orchestra.run.smithi007:> sudo hostname smithi007 2024-04-19T13:56:58.225 DEBUG:teuthology.orchestra.run.smithi007:> cat /etc/os-release 2024-04-19T13:56:58.281 INFO:teuthology.orchestra.run.smithi007.stdout:NAME="CentOS Stream" 2024-04-19T13:56:58.281 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION="9" 2024-04-19T13:56:58.281 INFO:teuthology.orchestra.run.smithi007.stdout:ID="centos" 2024-04-19T13:56:58.281 INFO:teuthology.orchestra.run.smithi007.stdout:ID_LIKE="rhel fedora" 2024-04-19T13:56:58.281 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_ID="9" 2024-04-19T13:56:58.281 INFO:teuthology.orchestra.run.smithi007.stdout:PLATFORM_ID="platform:el9" 2024-04-19T13:56:58.281 INFO:teuthology.orchestra.run.smithi007.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-19T13:56:58.281 INFO:teuthology.orchestra.run.smithi007.stdout:ANSI_COLOR="0;31" 2024-04-19T13:56:58.281 INFO:teuthology.orchestra.run.smithi007.stdout:LOGO="fedora-logo-icon" 2024-04-19T13:56:58.281 INFO:teuthology.orchestra.run.smithi007.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-19T13:56:58.281 INFO:teuthology.orchestra.run.smithi007.stdout:HOME_URL="https://centos.org/" 2024-04-19T13:56:58.282 INFO:teuthology.orchestra.run.smithi007.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-19T13:56:58.282 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-19T13:56:58.282 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-19T13:56:58.282 INFO:teuthology.provision.fog.smithi007:Deploy complete! 2024-04-19T13:56:58.284 DEBUG:teuthology.parallel:result is None 2024-04-19T13:57:01.031 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T13:57:01.288 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-19T13:57:01.288 DEBUG:teuthology.orchestra.run.smithi006:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-19T13:57:01.630 INFO:teuthology.provision.fog.smithi006:Node is ready 2024-04-19T13:57:01.630 DEBUG:teuthology.orchestra.run.smithi006:> hostname 2024-04-19T13:57:01.645 INFO:teuthology.orchestra.run.smithi006.stdout:smithi006.front.sepia.ceph.com 2024-04-19T13:57:01.646 DEBUG:teuthology.orchestra.run.smithi006:> grep smithi006.front.sepia.ceph.com /etc/hosts 2024-04-19T13:57:01.701 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6 smithi006.front.sepia.ceph.com smithi006 2024-04-19T13:57:01.702 DEBUG:teuthology.orchestra.run.smithi006:> sudo hostname smithi006 2024-04-19T13:57:01.814 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/smithi006.front.sepia.ceph.com/smithi006/g' /etc/hosts 2024-04-19T13:57:01.846 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/172.21.15.6/172.21.15.6/g' /etc/hosts 2024-04-19T13:57:01.918 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/smithi006.front.sepia.ceph.com/smithi006/g' /etc/hostname 2024-04-19T13:57:01.989 DEBUG:teuthology.orchestra.run.smithi006:> sudo hostname smithi006 2024-04-19T13:57:02.060 DEBUG:teuthology.orchestra.run.smithi006:> cat /etc/os-release 2024-04-19T13:57:02.115 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="CentOS Stream" 2024-04-19T13:57:02.115 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="9" 2024-04-19T13:57:02.115 INFO:teuthology.orchestra.run.smithi006.stdout:ID="centos" 2024-04-19T13:57:02.116 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE="rhel fedora" 2024-04-19T13:57:02.116 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="9" 2024-04-19T13:57:02.116 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM_ID="platform:el9" 2024-04-19T13:57:02.116 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-19T13:57:02.116 INFO:teuthology.orchestra.run.smithi006.stdout:ANSI_COLOR="0;31" 2024-04-19T13:57:02.116 INFO:teuthology.orchestra.run.smithi006.stdout:LOGO="fedora-logo-icon" 2024-04-19T13:57:02.116 INFO:teuthology.orchestra.run.smithi006.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-19T13:57:02.116 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://centos.org/" 2024-04-19T13:57:02.116 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-19T13:57:02.116 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-19T13:57:02.116 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-19T13:57:02.116 INFO:teuthology.provision.fog.smithi006:Deploy complete! 2024-04-19T13:57:02.117 DEBUG:teuthology.parallel:result is None 2024-04-19T13:57:04.058 WARNING:teuthology.provision.fog.smithi104:timed out 2024-04-19T13:57:10.064 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T13:57:10.307 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-19T13:57:10.308 DEBUG:teuthology.orchestra.run.smithi104:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-19T13:57:10.638 INFO:teuthology.provision.fog.smithi104:Node is ready 2024-04-19T13:57:10.638 DEBUG:teuthology.orchestra.run.smithi104:> hostname 2024-04-19T13:57:10.652 INFO:teuthology.orchestra.run.smithi104.stdout:smithi104.front.sepia.ceph.com 2024-04-19T13:57:10.653 DEBUG:teuthology.orchestra.run.smithi104:> grep smithi104.front.sepia.ceph.com /etc/hosts 2024-04-19T13:57:10.706 INFO:teuthology.orchestra.run.smithi104.stdout:172.21.15.104 smithi104.front.sepia.ceph.com smithi104 2024-04-19T13:57:10.706 DEBUG:teuthology.orchestra.run.smithi104:> sudo hostname smithi104 2024-04-19T13:57:10.825 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/smithi104.front.sepia.ceph.com/smithi104/g' /etc/hosts 2024-04-19T13:57:10.853 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/172.21.15.104/172.21.15.104/g' /etc/hosts 2024-04-19T13:57:10.919 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/smithi104.front.sepia.ceph.com/smithi104/g' /etc/hostname 2024-04-19T13:57:10.987 DEBUG:teuthology.orchestra.run.smithi104:> sudo hostname smithi104 2024-04-19T13:57:11.052 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release 2024-04-19T13:57:11.104 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="CentOS Stream" 2024-04-19T13:57:11.104 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="9" 2024-04-19T13:57:11.104 INFO:teuthology.orchestra.run.smithi104.stdout:ID="centos" 2024-04-19T13:57:11.104 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE="rhel fedora" 2024-04-19T13:57:11.104 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="9" 2024-04-19T13:57:11.104 INFO:teuthology.orchestra.run.smithi104.stdout:PLATFORM_ID="platform:el9" 2024-04-19T13:57:11.104 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-19T13:57:11.104 INFO:teuthology.orchestra.run.smithi104.stdout:ANSI_COLOR="0;31" 2024-04-19T13:57:11.104 INFO:teuthology.orchestra.run.smithi104.stdout:LOGO="fedora-logo-icon" 2024-04-19T13:57:11.104 INFO:teuthology.orchestra.run.smithi104.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-19T13:57:11.105 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://centos.org/" 2024-04-19T13:57:11.105 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-19T13:57:11.105 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-19T13:57:11.105 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-19T13:57:11.105 INFO:teuthology.provision.fog.smithi104:Deploy complete! 2024-04-19T13:57:11.105 DEBUG:teuthology.parallel:result is None 2024-04-19T13:57:11.319 INFO:teuthology.lock.ops:Checking smithi006.front.sepia.ceph.com 2024-04-19T13:57:11.319 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-19T13:57:11.350 INFO:teuthology.lock.ops:Checking smithi007.front.sepia.ceph.com 2024-04-19T13:57:11.350 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-19T13:57:11.366 INFO:teuthology.lock.ops:Checking smithi104.front.sepia.ceph.com 2024-04-19T13:57:11.366 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-19T13:57:11.384 INFO:teuthology.lock.ops:Updating [smithi006.front.sepia.ceph.com]: set os type and version on server 2024-04-19T13:57:11.384 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-04-19T13:57:11.385 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T13:57:11.487 DEBUG:teuthology.orchestra.run.smithi006:> true 2024-04-19T13:57:11.555 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-04-19T13:57:11.555 DEBUG:teuthology.orchestra.run.smithi006:> uname -m 2024-04-19T13:57:11.611 INFO:teuthology.orchestra.run.smithi006.stdout:x86_64 2024-04-19T13:57:11.612 DEBUG:teuthology.orchestra.run.smithi006:> cat /etc/os-release 2024-04-19T13:57:11.668 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="CentOS Stream" 2024-04-19T13:57:11.668 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="9" 2024-04-19T13:57:11.669 INFO:teuthology.orchestra.run.smithi006.stdout:ID="centos" 2024-04-19T13:57:11.669 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE="rhel fedora" 2024-04-19T13:57:11.669 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="9" 2024-04-19T13:57:11.669 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM_ID="platform:el9" 2024-04-19T13:57:11.669 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-19T13:57:11.669 INFO:teuthology.orchestra.run.smithi006.stdout:ANSI_COLOR="0;31" 2024-04-19T13:57:11.669 INFO:teuthology.orchestra.run.smithi006.stdout:LOGO="fedora-logo-icon" 2024-04-19T13:57:11.669 INFO:teuthology.orchestra.run.smithi006.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-19T13:57:11.669 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://centos.org/" 2024-04-19T13:57:11.669 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-19T13:57:11.669 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-19T13:57:11.669 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-19T13:57:11.670 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2024-04-19T13:57:11.692 INFO:teuthology.lock.ops:Updating [smithi007.front.sepia.ceph.com]: set os type and version on server 2024-04-19T13:57:11.692 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-04-19T13:57:11.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T13:57:11.793 DEBUG:teuthology.orchestra.run.smithi007:> true 2024-04-19T13:57:11.972 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-04-19T13:57:11.973 DEBUG:teuthology.orchestra.run.smithi007:> uname -m 2024-04-19T13:57:12.028 INFO:teuthology.orchestra.run.smithi007.stdout:x86_64 2024-04-19T13:57:12.028 DEBUG:teuthology.orchestra.run.smithi007:> cat /etc/os-release 2024-04-19T13:57:12.082 INFO:teuthology.orchestra.run.smithi007.stdout:NAME="CentOS Stream" 2024-04-19T13:57:12.082 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION="9" 2024-04-19T13:57:12.083 INFO:teuthology.orchestra.run.smithi007.stdout:ID="centos" 2024-04-19T13:57:12.083 INFO:teuthology.orchestra.run.smithi007.stdout:ID_LIKE="rhel fedora" 2024-04-19T13:57:12.083 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_ID="9" 2024-04-19T13:57:12.083 INFO:teuthology.orchestra.run.smithi007.stdout:PLATFORM_ID="platform:el9" 2024-04-19T13:57:12.083 INFO:teuthology.orchestra.run.smithi007.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-19T13:57:12.083 INFO:teuthology.orchestra.run.smithi007.stdout:ANSI_COLOR="0;31" 2024-04-19T13:57:12.083 INFO:teuthology.orchestra.run.smithi007.stdout:LOGO="fedora-logo-icon" 2024-04-19T13:57:12.083 INFO:teuthology.orchestra.run.smithi007.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-19T13:57:12.083 INFO:teuthology.orchestra.run.smithi007.stdout:HOME_URL="https://centos.org/" 2024-04-19T13:57:12.083 INFO:teuthology.orchestra.run.smithi007.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-19T13:57:12.083 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-19T13:57:12.083 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-19T13:57:12.084 INFO:teuthology.lock.ops:Updating smithi007.front.sepia.ceph.com on lock server 2024-04-19T13:57:12.109 INFO:teuthology.lock.ops:Updating [smithi104.front.sepia.ceph.com]: set os type and version on server 2024-04-19T13:57:12.109 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-04-19T13:57:12.109 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T13:57:12.198 DEBUG:teuthology.orchestra.run.smithi104:> true 2024-04-19T13:57:12.270 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-04-19T13:57:12.270 DEBUG:teuthology.orchestra.run.smithi104:> uname -m 2024-04-19T13:57:12.326 INFO:teuthology.orchestra.run.smithi104.stdout:x86_64 2024-04-19T13:57:12.326 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release 2024-04-19T13:57:12.382 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="CentOS Stream" 2024-04-19T13:57:12.382 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="9" 2024-04-19T13:57:12.382 INFO:teuthology.orchestra.run.smithi104.stdout:ID="centos" 2024-04-19T13:57:12.382 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE="rhel fedora" 2024-04-19T13:57:12.382 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="9" 2024-04-19T13:57:12.382 INFO:teuthology.orchestra.run.smithi104.stdout:PLATFORM_ID="platform:el9" 2024-04-19T13:57:12.383 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-19T13:57:12.383 INFO:teuthology.orchestra.run.smithi104.stdout:ANSI_COLOR="0;31" 2024-04-19T13:57:12.383 INFO:teuthology.orchestra.run.smithi104.stdout:LOGO="fedora-logo-icon" 2024-04-19T13:57:12.383 INFO:teuthology.orchestra.run.smithi104.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-19T13:57:12.383 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://centos.org/" 2024-04-19T13:57:12.383 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-19T13:57:12.383 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-19T13:57:12.383 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-19T13:57:12.383 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server 2024-04-19T13:57:12.408 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-19T13:57:12.494 INFO:teuthology.dispatcher.supervisor:Running job 7663521 2024-04-19T13:57:12.494 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/virtualenv/bin/teuthology -v --owner scheduled_adking@teuthology --archive /home/teuthworker/archive/adking-2024-04-19_13:19:23-orch:cephadm-wip-adk-testing-2024-04-17-1713-distro-default-smithi/7663521 --name adking-2024-04-19_13:19:23-orch:cephadm-wip-adk-testing-2024-04-17-1713-distro-default-smithi --description orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_monitoring_stack_basic} -- /home/teuthworker/archive/adking-2024-04-19_13:19:23-orch:cephadm-wip-adk-testing-2024-04-17-1713-distro-default-smithi/7663521/orig.config.yaml 2024-04-19T13:57:12.498 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/adking-2024-04-19_13:19:23-orch:cephadm-wip-adk-testing-2024-04-17-1713-distro-default-smithi/7663521 2024-04-19T13:57:12.498 INFO:teuthology.dispatcher.supervisor:Job PID: 855486 2024-04-19T13:57:12.498 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-19T13:59:12.599 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-19T14:01:12.771 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-19T14:03:12.943 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-19T14:05:13.119 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-19T14:05:13.182 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1