2024-04-15T20:11:21.515 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-15T20:11:21.515 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T20:11:21.676 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2ba9f04c10>, signals=[15]) 2024-04-15T20:11:21.677 INFO:teuthology.lock.ops:Start node 'smithi031.front.sepia.ceph.com' reimaging 2024-04-15T20:11:21.677 INFO:teuthology.lock.ops:Updating [smithi031.front.sepia.ceph.com]: reset os type and version on server 2024-04-15T20:11:21.677 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server 2024-04-15T20:11:21.697 INFO:teuthology.lock.ops:Start node 'smithi037.front.sepia.ceph.com' reimaging 2024-04-15T20:11:21.697 INFO:teuthology.lock.ops:Updating [smithi037.front.sepia.ceph.com]: reset os type and version on server 2024-04-15T20:11:21.697 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server 2024-04-15T20:11:21.713 INFO:teuthology.lock.ops:Start node 'smithi172.front.sepia.ceph.com' reimaging 2024-04-15T20:11:21.713 INFO:teuthology.lock.ops:Updating [smithi172.front.sepia.ceph.com]: reset os type and version on server 2024-04-15T20:11:21.713 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2024-04-15T20:11:21.799 DEBUG:teuthology.provision.fog.smithi031:Requesting image smithi_centos_9.stream (ID 10) 2024-04-15T20:11:21.816 DEBUG:teuthology.provision.fog.smithi037:Requesting image smithi_centos_9.stream (ID 10) 2024-04-15T20:11:21.837 DEBUG:teuthology.provision.fog.smithi172:Requesting image smithi_centos_9.stream (ID 10) 2024-04-15T20:11:21.844 INFO:teuthology.provision.fog.smithi031:Scheduling deploy of centos 9.stream 2024-04-15T20:11:21.861 INFO:teuthology.provision.fog.smithi037:Scheduling deploy of centos 9.stream 2024-04-15T20:11:21.881 INFO:teuthology.provision.fog.smithi172:Scheduling deploy of centos 9.stream 2024-04-15T20:11:22.282 INFO:teuthology.orchestra.console.smithi037:Power off 2024-04-15T20:11:22.282 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-15T20:11:22.294 INFO:teuthology.orchestra.console.smithi172:Power off 2024-04-15T20:11:22.295 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-15T20:11:22.304 INFO:teuthology.orchestra.console.smithi031:Power off 2024-04-15T20:11:22.305 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-15T20:11:22.312 DEBUG:teuthology.orchestra.console.smithi037:power off output: Chassis Power Control: Down/Off 2024-04-15T20:11:22.313 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T20:11:22.321 DEBUG:teuthology.orchestra.console.smithi172:power off output: Chassis Power Control: Down/Off 2024-04-15T20:11:22.321 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T20:11:22.332 DEBUG:teuthology.orchestra.console.smithi031:power off output: Chassis Power Control: Down/Off 2024-04-15T20:11:22.332 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T20:11:22.340 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is on 2024-04-15T20:11:22.341 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2024-04-15T20:11:22.356 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2024-04-15T20:11:26.345 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T20:11:26.351 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T20:11:26.357 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T20:11:26.453 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is on 2024-04-15T20:11:26.459 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2024-04-15T20:11:26.466 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2024-04-15T20:11:30.458 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T20:11:30.465 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T20:11:30.471 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T20:11:30.568 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is on 2024-04-15T20:11:30.572 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2024-04-15T20:11:30.579 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2024-04-15T20:11:34.570 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T20:11:34.578 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T20:11:34.584 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T20:11:34.681 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is off 2024-04-15T20:11:34.686 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off 2024-04-15T20:11:34.693 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off 2024-04-15T20:11:34.782 INFO:teuthology.orchestra.console.smithi037:Power off completed 2024-04-15T20:11:34.786 INFO:teuthology.orchestra.console.smithi172:Power off completed 2024-04-15T20:11:34.794 INFO:teuthology.orchestra.console.smithi031:Power off completed 2024-04-15T20:11:34.883 INFO:teuthology.orchestra.console.smithi037:Power on 2024-04-15T20:11:34.883 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-15T20:11:34.891 INFO:teuthology.orchestra.console.smithi172:Power on 2024-04-15T20:11:34.891 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-15T20:11:34.898 INFO:teuthology.orchestra.console.smithi031:Power on 2024-04-15T20:11:34.899 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-15T20:11:34.907 DEBUG:teuthology.orchestra.console.smithi037:power on output: Chassis Power Control: Up/On 2024-04-15T20:11:34.907 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T20:11:34.915 DEBUG:teuthology.orchestra.console.smithi172:power on output: Chassis Power Control: Up/On 2024-04-15T20:11:34.915 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T20:11:34.924 DEBUG:teuthology.orchestra.console.smithi031:power on output: Chassis Power Control: Up/On 2024-04-15T20:11:34.924 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T20:11:34.934 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is off 2024-04-15T20:11:34.936 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off 2024-04-15T20:11:34.948 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off 2024-04-15T20:11:38.938 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T20:11:38.946 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T20:11:38.956 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T20:11:39.049 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is on 2024-04-15T20:11:39.058 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off 2024-04-15T20:11:39.065 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2024-04-15T20:11:39.150 INFO:teuthology.orchestra.console.smithi037:Power on completed 2024-04-15T20:11:39.166 INFO:teuthology.orchestra.console.smithi031:Power on completed 2024-04-15T20:11:39.251 INFO:teuthology.provision.fog.smithi037:Waiting for deploy to finish 2024-04-15T20:11:39.267 INFO:teuthology.provision.fog.smithi031:Waiting for deploy to finish 2024-04-15T20:11:43.062 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T20:11:43.171 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2024-04-15T20:11:43.272 INFO:teuthology.orchestra.console.smithi172:Power on completed 2024-04-15T20:11:43.373 INFO:teuthology.provision.fog.smithi172:Waiting for deploy to finish 2024-04-15T20:14:11.202 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T20:14:14.270 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31 2024-04-15T20:14:20.278 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T20:14:23.358 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31 2024-04-15T20:14:29.363 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T20:14:32.414 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31 2024-04-15T20:14:38.418 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T20:14:41.470 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31 2024-04-15T20:14:47.477 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T20:15:22.581 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T20:15:25.663 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37 2024-04-15T20:15:31.665 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T20:15:34.719 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37 2024-04-15T20:15:40.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T20:15:43.806 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37 2024-04-15T20:15:47.481 WARNING:teuthology.provision.fog.smithi031:timed out 2024-04-15T20:15:49.810 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T20:15:52.866 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37 2024-04-15T20:15:53.484 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T20:15:53.772 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-15T20:15:53.772 DEBUG:teuthology.orchestra.run.smithi031:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-15T20:15:54.110 INFO:teuthology.provision.fog.smithi031:Node is ready 2024-04-15T20:15:54.110 DEBUG:teuthology.orchestra.run.smithi031:> hostname 2024-04-15T20:15:54.125 INFO:teuthology.orchestra.run.smithi031.stdout:smithi031.front.sepia.ceph.com 2024-04-15T20:15:54.126 DEBUG:teuthology.orchestra.run.smithi031:> grep smithi031.front.sepia.ceph.com /etc/hosts 2024-04-15T20:15:54.182 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31 smithi031.front.sepia.ceph.com smithi031 2024-04-15T20:15:54.182 DEBUG:teuthology.orchestra.run.smithi031:> sudo hostname smithi031 2024-04-15T20:15:54.285 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/smithi031.front.sepia.ceph.com/smithi031/g' /etc/hosts 2024-04-15T20:15:54.317 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/172.21.15.31/172.21.15.31/g' /etc/hosts 2024-04-15T20:15:54.388 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/smithi031.front.sepia.ceph.com/smithi031/g' /etc/hostname 2024-04-15T20:15:54.459 DEBUG:teuthology.orchestra.run.smithi031:> sudo hostname smithi031 2024-04-15T20:15:54.529 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release 2024-04-15T20:15:54.584 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="CentOS Stream" 2024-04-15T20:15:54.584 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="9" 2024-04-15T20:15:54.584 INFO:teuthology.orchestra.run.smithi031.stdout:ID="centos" 2024-04-15T20:15:54.585 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE="rhel fedora" 2024-04-15T20:15:54.585 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="9" 2024-04-15T20:15:54.585 INFO:teuthology.orchestra.run.smithi031.stdout:PLATFORM_ID="platform:el9" 2024-04-15T20:15:54.585 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-15T20:15:54.585 INFO:teuthology.orchestra.run.smithi031.stdout:ANSI_COLOR="0;31" 2024-04-15T20:15:54.585 INFO:teuthology.orchestra.run.smithi031.stdout:LOGO="fedora-logo-icon" 2024-04-15T20:15:54.585 INFO:teuthology.orchestra.run.smithi031.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-15T20:15:54.585 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://centos.org/" 2024-04-15T20:15:54.585 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-15T20:15:54.585 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-15T20:15:54.585 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-15T20:15:54.586 INFO:teuthology.provision.fog.smithi031:Deploy complete! 2024-04-15T20:15:54.587 DEBUG:teuthology.parallel:result is None 2024-04-15T20:15:58.872 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T20:16:03.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T20:16:06.302 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-04-15T20:16:12.310 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T20:16:15.390 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-04-15T20:16:21.394 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T20:16:24.446 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-04-15T20:16:30.453 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T20:16:33.534 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-04-15T20:16:39.541 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T20:16:42.622 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-04-15T20:16:48.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T20:16:51.678 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-04-15T20:16:57.685 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T20:16:58.876 WARNING:teuthology.provision.fog.smithi037:timed out 2024-04-15T20:17:00.766 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-04-15T20:17:04.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T20:17:05.146 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-15T20:17:05.146 DEBUG:teuthology.orchestra.run.smithi037:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-15T20:17:05.493 INFO:teuthology.provision.fog.smithi037:Node is ready 2024-04-15T20:17:05.493 DEBUG:teuthology.orchestra.run.smithi037:> hostname 2024-04-15T20:17:05.508 INFO:teuthology.orchestra.run.smithi037.stdout:smithi037.front.sepia.ceph.com 2024-04-15T20:17:05.508 DEBUG:teuthology.orchestra.run.smithi037:> grep smithi037.front.sepia.ceph.com /etc/hosts 2024-04-15T20:17:05.565 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37 smithi037.front.sepia.ceph.com smithi037 2024-04-15T20:17:05.565 DEBUG:teuthology.orchestra.run.smithi037:> sudo hostname smithi037 2024-04-15T20:17:05.665 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i -e 's/smithi037.front.sepia.ceph.com/smithi037/g' /etc/hosts 2024-04-15T20:17:05.697 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i -e 's/172.21.15.37/172.21.15.37/g' /etc/hosts 2024-04-15T20:17:05.769 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i -e 's/smithi037.front.sepia.ceph.com/smithi037/g' /etc/hostname 2024-04-15T20:17:05.841 DEBUG:teuthology.orchestra.run.smithi037:> sudo hostname smithi037 2024-04-15T20:17:05.912 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release 2024-04-15T20:17:05.967 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="CentOS Stream" 2024-04-15T20:17:05.967 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="9" 2024-04-15T20:17:05.968 INFO:teuthology.orchestra.run.smithi037.stdout:ID="centos" 2024-04-15T20:17:05.968 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE="rhel fedora" 2024-04-15T20:17:05.968 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="9" 2024-04-15T20:17:05.968 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM_ID="platform:el9" 2024-04-15T20:17:05.968 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-15T20:17:05.968 INFO:teuthology.orchestra.run.smithi037.stdout:ANSI_COLOR="0;31" 2024-04-15T20:17:05.968 INFO:teuthology.orchestra.run.smithi037.stdout:LOGO="fedora-logo-icon" 2024-04-15T20:17:05.968 INFO:teuthology.orchestra.run.smithi037.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-15T20:17:05.968 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://centos.org/" 2024-04-15T20:17:05.968 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-15T20:17:05.968 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-15T20:17:05.968 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-15T20:17:05.968 INFO:teuthology.provision.fog.smithi037:Deploy complete! 2024-04-15T20:17:05.969 DEBUG:teuthology.parallel:result is None 2024-04-15T20:17:06.769 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T20:17:09.826 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-04-15T20:17:15.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T20:17:34.243 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-04-15T20:17:40.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T20:17:43.326 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-04-15T20:17:49.333 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T20:17:52.414 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-04-15T20:17:58.421 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T20:17:58.647 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-15T20:17:58.647 DEBUG:teuthology.orchestra.run.smithi172:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-15T20:18:18.999 INFO:teuthology.provision.fog.smithi172:Node is ready 2024-04-15T20:18:18.999 DEBUG:teuthology.orchestra.run.smithi172:> hostname 2024-04-15T20:18:19.057 INFO:teuthology.orchestra.run.smithi172.stdout:smithi172.front.sepia.ceph.com 2024-04-15T20:18:19.058 DEBUG:teuthology.orchestra.run.smithi172:> grep smithi172.front.sepia.ceph.com /etc/hosts 2024-04-15T20:18:19.115 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.15.172 smithi172.front.sepia.ceph.com smithi172 2024-04-15T20:18:19.116 DEBUG:teuthology.orchestra.run.smithi172:> sudo hostname smithi172 2024-04-15T20:18:19.254 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/smithi172.front.sepia.ceph.com/smithi172/g' /etc/hosts 2024-04-15T20:18:19.285 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/172.21.15.172/172.21.15.172/g' /etc/hosts 2024-04-15T20:18:19.354 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/smithi172.front.sepia.ceph.com/smithi172/g' /etc/hostname 2024-04-15T20:18:19.423 DEBUG:teuthology.orchestra.run.smithi172:> sudo hostname smithi172 2024-04-15T20:18:19.491 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2024-04-15T20:18:19.546 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="CentOS Stream" 2024-04-15T20:18:19.547 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="9" 2024-04-15T20:18:19.547 INFO:teuthology.orchestra.run.smithi172.stdout:ID="centos" 2024-04-15T20:18:19.547 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="rhel fedora" 2024-04-15T20:18:19.547 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="9" 2024-04-15T20:18:19.547 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el9" 2024-04-15T20:18:19.547 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-15T20:18:19.547 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2024-04-15T20:18:19.547 INFO:teuthology.orchestra.run.smithi172.stdout:LOGO="fedora-logo-icon" 2024-04-15T20:18:19.547 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-15T20:18:19.547 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://centos.org/" 2024-04-15T20:18:19.547 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-15T20:18:19.547 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-15T20:18:19.547 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-15T20:18:19.548 INFO:teuthology.provision.fog.smithi172:Deploy complete! 2024-04-15T20:18:19.548 DEBUG:teuthology.parallel:result is None 2024-04-15T20:18:19.776 INFO:teuthology.lock.ops:Checking smithi031.front.sepia.ceph.com 2024-04-15T20:18:19.776 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-15T20:18:19.798 INFO:teuthology.lock.ops:Checking smithi037.front.sepia.ceph.com 2024-04-15T20:18:19.798 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-15T20:18:19.814 INFO:teuthology.lock.ops:Checking smithi172.front.sepia.ceph.com 2024-04-15T20:18:19.814 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-15T20:18:19.832 INFO:teuthology.lock.ops:Updating [smithi031.front.sepia.ceph.com]: set os type and version on server 2024-04-15T20:18:19.832 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2024-04-15T20:18:19.832 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T20:18:19.934 DEBUG:teuthology.orchestra.run.smithi031:> true 2024-04-15T20:18:20.116 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi031.front.sepia.ceph.com' 2024-04-15T20:18:20.116 DEBUG:teuthology.orchestra.run.smithi031:> uname -m 2024-04-15T20:18:20.172 INFO:teuthology.orchestra.run.smithi031.stdout:x86_64 2024-04-15T20:18:20.172 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release 2024-04-15T20:18:20.226 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="CentOS Stream" 2024-04-15T20:18:20.226 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="9" 2024-04-15T20:18:20.226 INFO:teuthology.orchestra.run.smithi031.stdout:ID="centos" 2024-04-15T20:18:20.227 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE="rhel fedora" 2024-04-15T20:18:20.227 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="9" 2024-04-15T20:18:20.227 INFO:teuthology.orchestra.run.smithi031.stdout:PLATFORM_ID="platform:el9" 2024-04-15T20:18:20.227 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-15T20:18:20.227 INFO:teuthology.orchestra.run.smithi031.stdout:ANSI_COLOR="0;31" 2024-04-15T20:18:20.227 INFO:teuthology.orchestra.run.smithi031.stdout:LOGO="fedora-logo-icon" 2024-04-15T20:18:20.227 INFO:teuthology.orchestra.run.smithi031.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-15T20:18:20.227 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://centos.org/" 2024-04-15T20:18:20.227 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-15T20:18:20.227 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-15T20:18:20.227 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-15T20:18:20.228 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server 2024-04-15T20:18:20.248 INFO:teuthology.lock.ops:Updating [smithi037.front.sepia.ceph.com]: set os type and version on server 2024-04-15T20:18:20.248 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-04-15T20:18:20.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T20:18:20.347 DEBUG:teuthology.orchestra.run.smithi037:> true 2024-04-15T20:18:20.528 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-04-15T20:18:20.528 DEBUG:teuthology.orchestra.run.smithi037:> uname -m 2024-04-15T20:18:20.583 INFO:teuthology.orchestra.run.smithi037.stdout:x86_64 2024-04-15T20:18:20.583 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release 2024-04-15T20:18:20.638 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="CentOS Stream" 2024-04-15T20:18:20.638 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="9" 2024-04-15T20:18:20.638 INFO:teuthology.orchestra.run.smithi037.stdout:ID="centos" 2024-04-15T20:18:20.638 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE="rhel fedora" 2024-04-15T20:18:20.638 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="9" 2024-04-15T20:18:20.638 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM_ID="platform:el9" 2024-04-15T20:18:20.638 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-15T20:18:20.638 INFO:teuthology.orchestra.run.smithi037.stdout:ANSI_COLOR="0;31" 2024-04-15T20:18:20.639 INFO:teuthology.orchestra.run.smithi037.stdout:LOGO="fedora-logo-icon" 2024-04-15T20:18:20.639 INFO:teuthology.orchestra.run.smithi037.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-15T20:18:20.639 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://centos.org/" 2024-04-15T20:18:20.639 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-15T20:18:20.639 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-15T20:18:20.639 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-15T20:18:20.639 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server 2024-04-15T20:18:20.656 INFO:teuthology.lock.ops:Updating [smithi172.front.sepia.ceph.com]: set os type and version on server 2024-04-15T20:18:20.656 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-04-15T20:18:20.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T20:18:20.742 DEBUG:teuthology.orchestra.run.smithi172:> true 2024-04-15T20:18:20.815 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-04-15T20:18:20.815 DEBUG:teuthology.orchestra.run.smithi172:> uname -m 2024-04-15T20:18:20.871 INFO:teuthology.orchestra.run.smithi172.stdout:x86_64 2024-04-15T20:18:20.872 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2024-04-15T20:18:20.928 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="CentOS Stream" 2024-04-15T20:18:20.928 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="9" 2024-04-15T20:18:20.928 INFO:teuthology.orchestra.run.smithi172.stdout:ID="centos" 2024-04-15T20:18:20.928 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="rhel fedora" 2024-04-15T20:18:20.929 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="9" 2024-04-15T20:18:20.929 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el9" 2024-04-15T20:18:20.929 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-15T20:18:20.929 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2024-04-15T20:18:20.929 INFO:teuthology.orchestra.run.smithi172.stdout:LOGO="fedora-logo-icon" 2024-04-15T20:18:20.929 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-15T20:18:20.929 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://centos.org/" 2024-04-15T20:18:20.929 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-15T20:18:20.929 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-15T20:18:20.929 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-15T20:18:20.929 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2024-04-15T20:18:20.948 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T20:18:21.037 INFO:teuthology.dispatcher.supervisor:Running job 7657269 2024-04-15T20:18:21.037 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-04-15_20:08:15-orch-main-distro-default-smithi/7657269 --name teuthology-2024-04-15_20:08:15-orch-main-distro-default-smithi --description orch/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_monitoring_stack_basic} -- /home/teuthworker/archive/teuthology-2024-04-15_20:08:15-orch-main-distro-default-smithi/7657269/orig.config.yaml 2024-04-15T20:18:21.040 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-04-15_20:08:15-orch-main-distro-default-smithi/7657269 2024-04-15T20:18:21.040 INFO:teuthology.dispatcher.supervisor:Job PID: 366561 2024-04-15T20:18:21.041 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-15T20:20:21.139 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T20:22:21.312 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T20:24:21.483 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T20:26:21.709 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T20:28:21.905 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T20:30:22.092 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T20:32:22.262 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T20:34:22.427 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T20:36:22.602 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T20:38:22.760 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T20:40:22.933 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T20:42:23.089 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T20:44:23.283 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T20:46:23.457 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T20:48:23.627 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T20:50:23.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T20:50:23.861 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1