2024-04-15T11:07:58.673 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-15T11:07:58.673 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T11:07:58.861 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2db20f6c10>, signals=[15]) 2024-04-15T11:07:58.861 INFO:teuthology.lock.ops:Start node 'smithi069.front.sepia.ceph.com' reimaging 2024-04-15T11:07:58.862 INFO:teuthology.lock.ops:Updating [smithi069.front.sepia.ceph.com]: reset os type and version on server 2024-04-15T11:07:58.862 INFO:teuthology.lock.ops:Updating smithi069.front.sepia.ceph.com on lock server 2024-04-15T11:07:58.890 INFO:teuthology.lock.ops:Start node 'smithi136.front.sepia.ceph.com' reimaging 2024-04-15T11:07:58.890 INFO:teuthology.lock.ops:Updating [smithi136.front.sepia.ceph.com]: reset os type and version on server 2024-04-15T11:07:58.890 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server 2024-04-15T11:07:58.912 INFO:teuthology.lock.ops:Start node 'smithi204.front.sepia.ceph.com' reimaging 2024-04-15T11:07:58.912 INFO:teuthology.lock.ops:Updating [smithi204.front.sepia.ceph.com]: reset os type and version on server 2024-04-15T11:07:58.913 INFO:teuthology.lock.ops:Updating smithi204.front.sepia.ceph.com on lock server 2024-04-15T11:07:59.018 DEBUG:teuthology.provision.fog.smithi069:Requesting image smithi_centos_9.stream (ID 10) 2024-04-15T11:07:59.051 DEBUG:teuthology.provision.fog.smithi136:Requesting image smithi_centos_9.stream (ID 10) 2024-04-15T11:07:59.054 DEBUG:teuthology.provision.fog.smithi204:Requesting image smithi_centos_9.stream (ID 10) 2024-04-15T11:07:59.069 INFO:teuthology.provision.fog.smithi069:Scheduling deploy of centos 9.stream 2024-04-15T11:07:59.093 INFO:teuthology.provision.fog.smithi204:Scheduling deploy of centos 9.stream 2024-04-15T11:07:59.103 INFO:teuthology.provision.fog.smithi136:Scheduling deploy of centos 9.stream 2024-04-15T11:07:59.300 INFO:teuthology.orchestra.console.smithi204:Power off 2024-04-15T11:07:59.300 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-15T11:07:59.319 INFO:teuthology.orchestra.console.smithi069:Power off 2024-04-15T11:07:59.320 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-15T11:07:59.328 DEBUG:teuthology.orchestra.console.smithi204:power off output: Chassis Power Control: Down/Off 2024-04-15T11:07:59.328 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T11:07:59.340 DEBUG:teuthology.orchestra.console.smithi069:power off output: Chassis Power Control: Down/Off 2024-04-15T11:07:59.341 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T11:07:59.354 INFO:teuthology.orchestra.console.smithi136:Power off 2024-04-15T11:07:59.354 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-15T11:07:59.362 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on 2024-04-15T11:07:59.363 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is on 2024-04-15T11:07:59.378 DEBUG:teuthology.orchestra.console.smithi136:power off output: Chassis Power Control: Down/Off 2024-04-15T11:07:59.378 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T11:07:59.400 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on 2024-04-15T11:08:03.366 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T11:08:03.373 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T11:08:03.402 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T11:08:03.476 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on 2024-04-15T11:08:03.481 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is on 2024-04-15T11:08:03.516 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on 2024-04-15T11:08:07.478 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T11:08:07.484 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T11:08:07.516 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T11:08:07.587 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on 2024-04-15T11:08:07.593 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is on 2024-04-15T11:08:07.625 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off 2024-04-15T11:08:07.725 INFO:teuthology.orchestra.console.smithi136:Power off completed 2024-04-15T11:08:07.826 INFO:teuthology.orchestra.console.smithi136:Power on 2024-04-15T11:08:07.826 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-15T11:08:07.848 DEBUG:teuthology.orchestra.console.smithi136:power on output: Chassis Power Control: Up/On 2024-04-15T11:08:07.849 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T11:08:07.873 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off 2024-04-15T11:08:11.590 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T11:08:11.598 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T11:08:11.699 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off 2024-04-15T11:08:11.705 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is off 2024-04-15T11:08:11.801 INFO:teuthology.orchestra.console.smithi069:Power off completed 2024-04-15T11:08:11.806 INFO:teuthology.orchestra.console.smithi204:Power off completed 2024-04-15T11:08:11.874 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T11:08:11.902 INFO:teuthology.orchestra.console.smithi069:Power on 2024-04-15T11:08:11.902 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-15T11:08:11.909 INFO:teuthology.orchestra.console.smithi204:Power on 2024-04-15T11:08:11.910 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-15T11:08:11.926 DEBUG:teuthology.orchestra.console.smithi069:power on output: Chassis Power Control: Up/On 2024-04-15T11:08:11.926 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T11:08:11.938 DEBUG:teuthology.orchestra.console.smithi204:power on output: Chassis Power Control: Up/On 2024-04-15T11:08:11.938 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T11:08:11.954 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off 2024-04-15T11:08:11.968 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is off 2024-04-15T11:08:11.983 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off 2024-04-15T11:08:15.958 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T11:08:15.969 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T11:08:15.983 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T11:08:16.068 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off 2024-04-15T11:08:16.077 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is off 2024-04-15T11:08:16.092 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on 2024-04-15T11:08:16.193 INFO:teuthology.orchestra.console.smithi136:Power on completed 2024-04-15T11:08:16.293 INFO:teuthology.provision.fog.smithi136:Waiting for deploy to finish 2024-04-15T11:08:20.070 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T11:08:20.078 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-15T11:08:20.180 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on 2024-04-15T11:08:20.188 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is on 2024-04-15T11:08:20.281 INFO:teuthology.orchestra.console.smithi069:Power on completed 2024-04-15T11:08:20.289 INFO:teuthology.orchestra.console.smithi204:Power on completed 2024-04-15T11:08:20.382 INFO:teuthology.provision.fog.smithi069:Waiting for deploy to finish 2024-04-15T11:08:20.389 INFO:teuthology.provision.fog.smithi204:Waiting for deploy to finish 2024-04-15T11:10:47.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T11:10:50.174 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-04-15T11:10:51.112 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T11:10:54.174 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2024-04-15T11:10:56.176 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T11:10:59.230 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-04-15T11:11:00.177 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T11:11:03.230 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2024-04-15T11:11:05.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T11:11:06.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T11:11:08.290 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-04-15T11:11:09.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T11:11:09.246 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2024-04-15T11:11:12.293 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2024-04-15T11:11:14.294 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T11:11:15.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T11:11:17.374 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-04-15T11:11:18.294 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T11:11:18.302 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2024-04-15T11:11:21.378 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2024-04-15T11:11:23.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T11:11:24.303 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T11:11:26.433 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-04-15T11:11:27.358 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2024-04-15T11:11:27.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T11:11:30.430 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2024-04-15T11:11:32.437 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T11:11:33.360 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T11:11:35.518 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-04-15T11:11:36.414 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2024-04-15T11:11:36.432 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T11:11:39.486 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2024-04-15T11:11:41.520 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T11:11:42.416 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T11:11:45.474 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2024-04-15T11:11:45.487 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T11:11:51.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T11:11:54.562 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2024-04-15T11:12:00.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T11:12:03.650 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2024-04-15T11:12:09.655 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T11:12:41.555 WARNING:teuthology.provision.fog.smithi136:timed out 2024-04-15T11:12:45.494 WARNING:teuthology.provision.fog.smithi069:timed out 2024-04-15T11:12:47.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T11:12:47.798 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-15T11:12:47.799 DEBUG:teuthology.orchestra.run.smithi136:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-15T11:12:48.114 INFO:teuthology.provision.fog.smithi136:Node is ready 2024-04-15T11:12:48.114 DEBUG:teuthology.orchestra.run.smithi136:> hostname 2024-04-15T11:12:48.129 INFO:teuthology.orchestra.run.smithi136.stdout:smithi136.front.sepia.ceph.com 2024-04-15T11:12:48.129 DEBUG:teuthology.orchestra.run.smithi136:> grep smithi136.front.sepia.ceph.com /etc/hosts 2024-04-15T11:12:48.184 INFO:teuthology.orchestra.run.smithi136.stdout:172.21.15.136 smithi136.front.sepia.ceph.com smithi136 2024-04-15T11:12:48.184 DEBUG:teuthology.orchestra.run.smithi136:> sudo hostname smithi136 2024-04-15T11:12:48.319 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/smithi136.front.sepia.ceph.com/smithi136/g' /etc/hosts 2024-04-15T11:12:48.346 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/172.21.15.136/172.21.15.136/g' /etc/hosts 2024-04-15T11:12:48.413 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/smithi136.front.sepia.ceph.com/smithi136/g' /etc/hostname 2024-04-15T11:12:48.480 DEBUG:teuthology.orchestra.run.smithi136:> sudo hostname smithi136 2024-04-15T11:12:48.546 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release 2024-04-15T11:12:48.600 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="CentOS Stream" 2024-04-15T11:12:48.600 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="9" 2024-04-15T11:12:48.600 INFO:teuthology.orchestra.run.smithi136.stdout:ID="centos" 2024-04-15T11:12:48.600 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE="rhel fedora" 2024-04-15T11:12:48.600 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="9" 2024-04-15T11:12:48.600 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM_ID="platform:el9" 2024-04-15T11:12:48.600 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-15T11:12:48.600 INFO:teuthology.orchestra.run.smithi136.stdout:ANSI_COLOR="0;31" 2024-04-15T11:12:48.601 INFO:teuthology.orchestra.run.smithi136.stdout:LOGO="fedora-logo-icon" 2024-04-15T11:12:48.601 INFO:teuthology.orchestra.run.smithi136.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-15T11:12:48.601 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://centos.org/" 2024-04-15T11:12:48.601 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-15T11:12:48.601 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-15T11:12:48.601 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-15T11:12:48.602 INFO:teuthology.provision.fog.smithi136:Deploy complete! 2024-04-15T11:12:48.603 DEBUG:teuthology.parallel:result is None 2024-04-15T11:12:51.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T11:12:52.050 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-15T11:12:52.050 DEBUG:teuthology.orchestra.run.smithi069:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-15T11:12:52.376 INFO:teuthology.provision.fog.smithi069:Node is ready 2024-04-15T11:12:52.377 DEBUG:teuthology.orchestra.run.smithi069:> hostname 2024-04-15T11:12:52.391 INFO:teuthology.orchestra.run.smithi069.stdout:smithi069.front.sepia.ceph.com 2024-04-15T11:12:52.392 DEBUG:teuthology.orchestra.run.smithi069:> grep smithi069.front.sepia.ceph.com /etc/hosts 2024-04-15T11:12:52.448 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69 smithi069.front.sepia.ceph.com smithi069 2024-04-15T11:12:52.448 DEBUG:teuthology.orchestra.run.smithi069:> sudo hostname smithi069 2024-04-15T11:12:52.561 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i -e 's/smithi069.front.sepia.ceph.com/smithi069/g' /etc/hosts 2024-04-15T11:12:52.591 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i -e 's/172.21.15.69/172.21.15.69/g' /etc/hosts 2024-04-15T11:12:52.661 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i -e 's/smithi069.front.sepia.ceph.com/smithi069/g' /etc/hostname 2024-04-15T11:12:52.729 DEBUG:teuthology.orchestra.run.smithi069:> sudo hostname smithi069 2024-04-15T11:12:52.797 DEBUG:teuthology.orchestra.run.smithi069:> cat /etc/os-release 2024-04-15T11:12:52.851 INFO:teuthology.orchestra.run.smithi069.stdout:NAME="CentOS Stream" 2024-04-15T11:12:52.852 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION="9" 2024-04-15T11:12:52.852 INFO:teuthology.orchestra.run.smithi069.stdout:ID="centos" 2024-04-15T11:12:52.852 INFO:teuthology.orchestra.run.smithi069.stdout:ID_LIKE="rhel fedora" 2024-04-15T11:12:52.852 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION_ID="9" 2024-04-15T11:12:52.852 INFO:teuthology.orchestra.run.smithi069.stdout:PLATFORM_ID="platform:el9" 2024-04-15T11:12:52.852 INFO:teuthology.orchestra.run.smithi069.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-15T11:12:52.852 INFO:teuthology.orchestra.run.smithi069.stdout:ANSI_COLOR="0;31" 2024-04-15T11:12:52.852 INFO:teuthology.orchestra.run.smithi069.stdout:LOGO="fedora-logo-icon" 2024-04-15T11:12:52.852 INFO:teuthology.orchestra.run.smithi069.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-15T11:12:52.852 INFO:teuthology.orchestra.run.smithi069.stdout:HOME_URL="https://centos.org/" 2024-04-15T11:12:52.852 INFO:teuthology.orchestra.run.smithi069.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-15T11:12:52.852 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-15T11:12:52.852 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-15T11:12:52.853 INFO:teuthology.provision.fog.smithi069:Deploy complete! 2024-04-15T11:12:52.853 DEBUG:teuthology.parallel:result is None 2024-04-15T11:13:09.673 WARNING:teuthology.provision.fog.smithi204:timed out 2024-04-15T11:13:15.679 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T11:13:15.912 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-15T11:13:15.912 DEBUG:teuthology.orchestra.run.smithi204:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-15T11:13:16.240 INFO:teuthology.provision.fog.smithi204:Node is ready 2024-04-15T11:13:16.240 DEBUG:teuthology.orchestra.run.smithi204:> hostname 2024-04-15T11:13:16.255 INFO:teuthology.orchestra.run.smithi204.stdout:smithi204.front.sepia.ceph.com 2024-04-15T11:13:16.255 DEBUG:teuthology.orchestra.run.smithi204:> grep smithi204.front.sepia.ceph.com /etc/hosts 2024-04-15T11:13:16.311 INFO:teuthology.orchestra.run.smithi204.stdout:172.21.15.204 smithi204.front.sepia.ceph.com smithi204 2024-04-15T11:13:16.311 DEBUG:teuthology.orchestra.run.smithi204:> sudo hostname smithi204 2024-04-15T11:13:16.429 DEBUG:teuthology.orchestra.run.smithi204:> sudo sed -i -e 's/smithi204.front.sepia.ceph.com/smithi204/g' /etc/hosts 2024-04-15T11:13:16.457 DEBUG:teuthology.orchestra.run.smithi204:> sudo sed -i -e 's/172.21.15.204/172.21.15.204/g' /etc/hosts 2024-04-15T11:13:16.524 DEBUG:teuthology.orchestra.run.smithi204:> sudo sed -i -e 's/smithi204.front.sepia.ceph.com/smithi204/g' /etc/hostname 2024-04-15T11:13:16.591 DEBUG:teuthology.orchestra.run.smithi204:> sudo hostname smithi204 2024-04-15T11:13:16.657 DEBUG:teuthology.orchestra.run.smithi204:> cat /etc/os-release 2024-04-15T11:13:16.711 INFO:teuthology.orchestra.run.smithi204.stdout:NAME="CentOS Stream" 2024-04-15T11:13:16.711 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION="9" 2024-04-15T11:13:16.711 INFO:teuthology.orchestra.run.smithi204.stdout:ID="centos" 2024-04-15T11:13:16.712 INFO:teuthology.orchestra.run.smithi204.stdout:ID_LIKE="rhel fedora" 2024-04-15T11:13:16.712 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_ID="9" 2024-04-15T11:13:16.712 INFO:teuthology.orchestra.run.smithi204.stdout:PLATFORM_ID="platform:el9" 2024-04-15T11:13:16.712 INFO:teuthology.orchestra.run.smithi204.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-15T11:13:16.712 INFO:teuthology.orchestra.run.smithi204.stdout:ANSI_COLOR="0;31" 2024-04-15T11:13:16.712 INFO:teuthology.orchestra.run.smithi204.stdout:LOGO="fedora-logo-icon" 2024-04-15T11:13:16.712 INFO:teuthology.orchestra.run.smithi204.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-15T11:13:16.712 INFO:teuthology.orchestra.run.smithi204.stdout:HOME_URL="https://centos.org/" 2024-04-15T11:13:16.712 INFO:teuthology.orchestra.run.smithi204.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-15T11:13:16.712 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-15T11:13:16.712 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-15T11:13:16.712 INFO:teuthology.provision.fog.smithi204:Deploy complete! 2024-04-15T11:13:16.713 DEBUG:teuthology.parallel:result is None 2024-04-15T11:13:16.928 INFO:teuthology.lock.ops:Checking smithi069.front.sepia.ceph.com 2024-04-15T11:13:16.929 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-15T11:13:16.951 INFO:teuthology.lock.ops:Checking smithi136.front.sepia.ceph.com 2024-04-15T11:13:16.951 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-15T11:13:16.976 INFO:teuthology.lock.ops:Checking smithi204.front.sepia.ceph.com 2024-04-15T11:13:16.976 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-15T11:13:16.993 INFO:teuthology.lock.ops:Updating [smithi069.front.sepia.ceph.com]: set os type and version on server 2024-04-15T11:13:16.994 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi069.front.sepia.ceph.com' 2024-04-15T11:13:16.994 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T11:13:17.084 DEBUG:teuthology.orchestra.run.smithi069:> true 2024-04-15T11:13:17.248 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi069.front.sepia.ceph.com' 2024-04-15T11:13:17.249 DEBUG:teuthology.orchestra.run.smithi069:> uname -m 2024-04-15T11:13:17.303 INFO:teuthology.orchestra.run.smithi069.stdout:x86_64 2024-04-15T11:13:17.303 DEBUG:teuthology.orchestra.run.smithi069:> cat /etc/os-release 2024-04-15T11:13:17.357 INFO:teuthology.orchestra.run.smithi069.stdout:NAME="CentOS Stream" 2024-04-15T11:13:17.358 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION="9" 2024-04-15T11:13:17.358 INFO:teuthology.orchestra.run.smithi069.stdout:ID="centos" 2024-04-15T11:13:17.358 INFO:teuthology.orchestra.run.smithi069.stdout:ID_LIKE="rhel fedora" 2024-04-15T11:13:17.358 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION_ID="9" 2024-04-15T11:13:17.358 INFO:teuthology.orchestra.run.smithi069.stdout:PLATFORM_ID="platform:el9" 2024-04-15T11:13:17.358 INFO:teuthology.orchestra.run.smithi069.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-15T11:13:17.358 INFO:teuthology.orchestra.run.smithi069.stdout:ANSI_COLOR="0;31" 2024-04-15T11:13:17.358 INFO:teuthology.orchestra.run.smithi069.stdout:LOGO="fedora-logo-icon" 2024-04-15T11:13:17.358 INFO:teuthology.orchestra.run.smithi069.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-15T11:13:17.358 INFO:teuthology.orchestra.run.smithi069.stdout:HOME_URL="https://centos.org/" 2024-04-15T11:13:17.359 INFO:teuthology.orchestra.run.smithi069.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-15T11:13:17.359 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-15T11:13:17.359 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-15T11:13:17.359 INFO:teuthology.lock.ops:Updating smithi069.front.sepia.ceph.com on lock server 2024-04-15T11:13:17.385 INFO:teuthology.lock.ops:Updating [smithi136.front.sepia.ceph.com]: set os type and version on server 2024-04-15T11:13:17.385 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-04-15T11:13:17.385 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T11:13:17.471 DEBUG:teuthology.orchestra.run.smithi136:> true 2024-04-15T11:13:17.636 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-04-15T11:13:17.636 DEBUG:teuthology.orchestra.run.smithi136:> uname -m 2024-04-15T11:13:17.691 INFO:teuthology.orchestra.run.smithi136.stdout:x86_64 2024-04-15T11:13:17.692 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release 2024-04-15T11:13:17.746 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="CentOS Stream" 2024-04-15T11:13:17.746 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="9" 2024-04-15T11:13:17.746 INFO:teuthology.orchestra.run.smithi136.stdout:ID="centos" 2024-04-15T11:13:17.746 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE="rhel fedora" 2024-04-15T11:13:17.746 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="9" 2024-04-15T11:13:17.747 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM_ID="platform:el9" 2024-04-15T11:13:17.747 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-15T11:13:17.747 INFO:teuthology.orchestra.run.smithi136.stdout:ANSI_COLOR="0;31" 2024-04-15T11:13:17.747 INFO:teuthology.orchestra.run.smithi136.stdout:LOGO="fedora-logo-icon" 2024-04-15T11:13:17.747 INFO:teuthology.orchestra.run.smithi136.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-15T11:13:17.747 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://centos.org/" 2024-04-15T11:13:17.747 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-15T11:13:17.747 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-15T11:13:17.747 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-15T11:13:17.747 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server 2024-04-15T11:13:17.768 INFO:teuthology.lock.ops:Updating [smithi204.front.sepia.ceph.com]: set os type and version on server 2024-04-15T11:13:17.768 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-04-15T11:13:17.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-15T11:13:17.854 DEBUG:teuthology.orchestra.run.smithi204:> true 2024-04-15T11:13:17.922 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-04-15T11:13:17.922 DEBUG:teuthology.orchestra.run.smithi204:> uname -m 2024-04-15T11:13:17.977 INFO:teuthology.orchestra.run.smithi204.stdout:x86_64 2024-04-15T11:13:17.978 DEBUG:teuthology.orchestra.run.smithi204:> cat /etc/os-release 2024-04-15T11:13:18.033 INFO:teuthology.orchestra.run.smithi204.stdout:NAME="CentOS Stream" 2024-04-15T11:13:18.033 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION="9" 2024-04-15T11:13:18.033 INFO:teuthology.orchestra.run.smithi204.stdout:ID="centos" 2024-04-15T11:13:18.033 INFO:teuthology.orchestra.run.smithi204.stdout:ID_LIKE="rhel fedora" 2024-04-15T11:13:18.034 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_ID="9" 2024-04-15T11:13:18.034 INFO:teuthology.orchestra.run.smithi204.stdout:PLATFORM_ID="platform:el9" 2024-04-15T11:13:18.034 INFO:teuthology.orchestra.run.smithi204.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-15T11:13:18.034 INFO:teuthology.orchestra.run.smithi204.stdout:ANSI_COLOR="0;31" 2024-04-15T11:13:18.034 INFO:teuthology.orchestra.run.smithi204.stdout:LOGO="fedora-logo-icon" 2024-04-15T11:13:18.034 INFO:teuthology.orchestra.run.smithi204.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-15T11:13:18.034 INFO:teuthology.orchestra.run.smithi204.stdout:HOME_URL="https://centos.org/" 2024-04-15T11:13:18.034 INFO:teuthology.orchestra.run.smithi204.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-15T11:13:18.034 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-15T11:13:18.034 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-15T11:13:18.035 INFO:teuthology.lock.ops:Updating smithi204.front.sepia.ceph.com on lock server 2024-04-15T11:13:18.059 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T11:13:18.144 INFO:teuthology.dispatcher.supervisor:Running job 7644119 2024-04-15T11:13:18.144 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-04-07_20:00:14-rados-main-distro-default-smithi/7644119 --name teuthology-2024-04-07_20:00:14-rados-main-distro-default-smithi --description rados/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/connectivity task/test_rgw_multisite} -- /home/teuthworker/archive/teuthology-2024-04-07_20:00:14-rados-main-distro-default-smithi/7644119/orig.config.yaml 2024-04-15T11:13:18.147 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-04-07_20:00:14-rados-main-distro-default-smithi/7644119 2024-04-15T11:13:18.147 INFO:teuthology.dispatcher.supervisor:Job PID: 1712966 2024-04-15T11:13:18.147 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-15T11:15:18.247 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T11:17:18.424 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T11:19:18.607 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T11:21:18.779 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T11:23:18.952 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T11:25:19.125 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T11:27:19.299 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T11:29:19.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T11:31:19.633 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-15T11:31:19.706 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1