2024-04-18T05:17:45.616 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-18T05:17:45.617 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T05:17:45.792 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3b7d22cc10>, signals=[15]) 2024-04-18T05:17:45.792 INFO:teuthology.lock.ops:Start node 'smithi040.front.sepia.ceph.com' reimaging 2024-04-18T05:17:45.792 INFO:teuthology.lock.ops:Updating [smithi040.front.sepia.ceph.com]: reset os type and version on server 2024-04-18T05:17:45.792 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server 2024-04-18T05:17:45.812 INFO:teuthology.lock.ops:Start node 'smithi070.front.sepia.ceph.com' reimaging 2024-04-18T05:17:45.812 INFO:teuthology.lock.ops:Updating [smithi070.front.sepia.ceph.com]: reset os type and version on server 2024-04-18T05:17:45.812 INFO:teuthology.lock.ops:Updating smithi070.front.sepia.ceph.com on lock server 2024-04-18T05:17:45.836 INFO:teuthology.lock.ops:Start node 'smithi173.front.sepia.ceph.com' reimaging 2024-04-18T05:17:45.836 INFO:teuthology.lock.ops:Updating [smithi173.front.sepia.ceph.com]: reset os type and version on server 2024-04-18T05:17:45.837 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server 2024-04-18T05:17:45.958 DEBUG:teuthology.provision.fog.smithi040:Requesting image smithi_centos_9.stream (ID 10) 2024-04-18T05:17:45.968 DEBUG:teuthology.provision.fog.smithi070:Requesting image smithi_centos_9.stream (ID 10) 2024-04-18T05:17:45.971 DEBUG:teuthology.provision.fog.smithi173:Requesting image smithi_centos_9.stream (ID 10) 2024-04-18T05:17:46.012 INFO:teuthology.provision.fog.smithi040:Scheduling deploy of centos 9.stream 2024-04-18T05:17:46.015 INFO:teuthology.provision.fog.smithi070:Scheduling deploy of centos 9.stream 2024-04-18T05:17:46.029 INFO:teuthology.provision.fog.smithi173:Scheduling deploy of centos 9.stream 2024-04-18T05:17:46.236 INFO:teuthology.orchestra.console.smithi040:Power off 2024-04-18T05:17:46.237 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-18T05:17:46.260 INFO:teuthology.orchestra.console.smithi070:Power off 2024-04-18T05:17:46.261 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-18T05:17:46.278 DEBUG:teuthology.orchestra.console.smithi040:power off output: Chassis Power Control: Down/Off 2024-04-18T05:17:46.279 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T05:17:46.290 DEBUG:teuthology.orchestra.console.smithi070:power off output: Chassis Power Control: Down/Off 2024-04-18T05:17:46.290 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T05:17:46.306 INFO:teuthology.orchestra.console.smithi173:Power off 2024-04-18T05:17:46.307 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-18T05:17:46.314 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on 2024-04-18T05:17:46.315 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is on 2024-04-18T05:17:46.329 DEBUG:teuthology.orchestra.console.smithi173:power off output: Chassis Power Control: Down/Off 2024-04-18T05:17:46.330 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T05:17:46.354 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is on 2024-04-18T05:17:50.318 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T05:17:50.327 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T05:17:50.355 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T05:17:50.429 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on 2024-04-18T05:17:50.435 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is on 2024-04-18T05:17:50.465 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is on 2024-04-18T05:17:54.434 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T05:17:54.442 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T05:17:54.466 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T05:17:54.544 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on 2024-04-18T05:17:54.550 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is off 2024-04-18T05:17:54.576 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is off 2024-04-18T05:17:54.651 INFO:teuthology.orchestra.console.smithi070:Power off completed 2024-04-18T05:17:54.677 INFO:teuthology.orchestra.console.smithi173:Power off completed 2024-04-18T05:17:54.752 INFO:teuthology.orchestra.console.smithi070:Power on 2024-04-18T05:17:54.752 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-18T05:17:54.776 DEBUG:teuthology.orchestra.console.smithi070:power on output: Chassis Power Control: Up/On 2024-04-18T05:17:54.777 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T05:17:54.785 INFO:teuthology.orchestra.console.smithi173:Power on 2024-04-18T05:17:54.785 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-18T05:17:54.800 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is off 2024-04-18T05:17:54.807 DEBUG:teuthology.orchestra.console.smithi173:power on output: Chassis Power Control: Up/On 2024-04-18T05:17:54.807 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T05:17:54.828 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is off 2024-04-18T05:17:58.546 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T05:17:58.655 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off 2024-04-18T05:17:58.756 INFO:teuthology.orchestra.console.smithi040:Power off completed 2024-04-18T05:17:58.801 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T05:17:58.829 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T05:17:58.857 INFO:teuthology.orchestra.console.smithi040:Power on 2024-04-18T05:17:58.857 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-18T05:17:58.878 DEBUG:teuthology.orchestra.console.smithi040:power on output: Chassis Power Control: Up/On 2024-04-18T05:17:58.879 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T05:17:58.905 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off 2024-04-18T05:17:58.912 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is off 2024-04-18T05:17:58.939 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is off 2024-04-18T05:18:02.908 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T05:18:02.920 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T05:18:02.940 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T05:18:03.022 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on 2024-04-18T05:18:03.030 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is on 2024-04-18T05:18:03.050 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is on 2024-04-18T05:18:03.124 INFO:teuthology.orchestra.console.smithi040:Power on completed 2024-04-18T05:18:03.131 INFO:teuthology.orchestra.console.smithi070:Power on completed 2024-04-18T05:18:03.151 INFO:teuthology.orchestra.console.smithi173:Power on completed 2024-04-18T05:18:03.225 INFO:teuthology.provision.fog.smithi040:Waiting for deploy to finish 2024-04-18T05:18:03.232 INFO:teuthology.provision.fog.smithi070:Waiting for deploy to finish 2024-04-18T05:18:03.252 INFO:teuthology.provision.fog.smithi173:Waiting for deploy to finish 2024-04-18T05:20:34.033 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T05:20:34.039 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T05:20:34.042 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T05:20:37.086 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-04-18T05:20:37.118 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40 2024-04-18T05:20:37.119 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2024-04-18T05:20:43.091 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T05:20:43.120 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T05:20:43.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T05:20:46.142 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-04-18T05:20:46.174 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40 2024-04-18T05:20:46.175 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2024-04-18T05:20:52.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T05:20:52.176 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T05:20:52.178 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T05:20:55.202 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-04-18T05:20:55.230 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40 2024-04-18T05:20:55.230 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2024-04-18T05:21:01.207 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T05:21:01.232 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T05:21:01.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T05:21:04.286 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40 2024-04-18T05:21:04.287 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2024-04-18T05:21:04.287 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-04-18T05:21:10.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T05:21:10.294 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T05:21:10.295 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T05:21:13.342 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40 2024-04-18T05:21:13.378 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2024-04-18T05:21:13.379 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-04-18T05:21:19.349 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T05:21:19.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T05:21:19.381 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T05:21:22.430 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40 2024-04-18T05:21:22.431 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2024-04-18T05:21:22.462 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-04-18T05:21:28.435 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T05:21:28.437 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T05:21:28.466 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T05:21:31.486 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40 2024-04-18T05:21:37.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T05:21:40.542 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40 2024-04-18T05:21:46.547 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T05:21:49.598 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40 2024-04-18T05:21:55.605 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T05:21:58.686 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40 2024-04-18T05:22:04.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T05:22:28.459 WARNING:teuthology.provision.fog.smithi173:timed out 2024-04-18T05:22:28.468 WARNING:teuthology.provision.fog.smithi070:timed out 2024-04-18T05:22:34.466 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T05:22:34.469 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T05:22:34.790 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-18T05:22:34.791 DEBUG:teuthology.orchestra.run.smithi070:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-18T05:22:34.970 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-18T05:22:34.970 DEBUG:teuthology.orchestra.run.smithi173:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-18T05:22:35.107 INFO:teuthology.provision.fog.smithi070:Node is ready 2024-04-18T05:22:35.108 DEBUG:teuthology.orchestra.run.smithi070:> hostname 2024-04-18T05:22:35.122 INFO:teuthology.orchestra.run.smithi070.stdout:smithi070.front.sepia.ceph.com 2024-04-18T05:22:35.122 DEBUG:teuthology.orchestra.run.smithi070:> grep smithi070.front.sepia.ceph.com /etc/hosts 2024-04-18T05:22:35.178 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70 smithi070.front.sepia.ceph.com smithi070 2024-04-18T05:22:35.179 DEBUG:teuthology.orchestra.run.smithi070:> sudo hostname smithi070 2024-04-18T05:22:35.284 INFO:teuthology.provision.fog.smithi173:Node is ready 2024-04-18T05:22:35.284 DEBUG:teuthology.orchestra.run.smithi173:> hostname 2024-04-18T05:22:35.298 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i -e 's/smithi070.front.sepia.ceph.com/smithi070/g' /etc/hosts 2024-04-18T05:22:35.299 INFO:teuthology.orchestra.run.smithi173.stdout:smithi173.front.sepia.ceph.com 2024-04-18T05:22:35.299 DEBUG:teuthology.orchestra.run.smithi173:> grep smithi173.front.sepia.ceph.com /etc/hosts 2024-04-18T05:22:35.327 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i -e 's/172.21.15.70/172.21.15.70/g' /etc/hosts 2024-04-18T05:22:35.354 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.15.173 smithi173.front.sepia.ceph.com smithi173 2024-04-18T05:22:35.354 DEBUG:teuthology.orchestra.run.smithi173:> sudo hostname smithi173 2024-04-18T05:22:35.394 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i -e 's/smithi070.front.sepia.ceph.com/smithi070/g' /etc/hostname 2024-04-18T05:22:35.461 DEBUG:teuthology.orchestra.run.smithi070:> sudo hostname smithi070 2024-04-18T05:22:35.468 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i -e 's/smithi173.front.sepia.ceph.com/smithi173/g' /etc/hosts 2024-04-18T05:22:35.496 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i -e 's/172.21.15.173/172.21.15.173/g' /etc/hosts 2024-04-18T05:22:35.527 DEBUG:teuthology.orchestra.run.smithi070:> cat /etc/os-release 2024-04-18T05:22:35.565 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i -e 's/smithi173.front.sepia.ceph.com/smithi173/g' /etc/hostname 2024-04-18T05:22:35.582 INFO:teuthology.orchestra.run.smithi070.stdout:NAME="CentOS Stream" 2024-04-18T05:22:35.582 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION="9" 2024-04-18T05:22:35.582 INFO:teuthology.orchestra.run.smithi070.stdout:ID="centos" 2024-04-18T05:22:35.582 INFO:teuthology.orchestra.run.smithi070.stdout:ID_LIKE="rhel fedora" 2024-04-18T05:22:35.582 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_ID="9" 2024-04-18T05:22:35.582 INFO:teuthology.orchestra.run.smithi070.stdout:PLATFORM_ID="platform:el9" 2024-04-18T05:22:35.582 INFO:teuthology.orchestra.run.smithi070.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-18T05:22:35.582 INFO:teuthology.orchestra.run.smithi070.stdout:ANSI_COLOR="0;31" 2024-04-18T05:22:35.582 INFO:teuthology.orchestra.run.smithi070.stdout:LOGO="fedora-logo-icon" 2024-04-18T05:22:35.583 INFO:teuthology.orchestra.run.smithi070.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-18T05:22:35.583 INFO:teuthology.orchestra.run.smithi070.stdout:HOME_URL="https://centos.org/" 2024-04-18T05:22:35.583 INFO:teuthology.orchestra.run.smithi070.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T05:22:35.583 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-18T05:22:35.583 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-18T05:22:35.584 INFO:teuthology.provision.fog.smithi070:Deploy complete! 2024-04-18T05:22:35.585 DEBUG:teuthology.parallel:result is None 2024-04-18T05:22:35.633 DEBUG:teuthology.orchestra.run.smithi173:> sudo hostname smithi173 2024-04-18T05:22:35.699 DEBUG:teuthology.orchestra.run.smithi173:> cat /etc/os-release 2024-04-18T05:22:35.758 INFO:teuthology.orchestra.run.smithi173.stdout:NAME="CentOS Stream" 2024-04-18T05:22:35.758 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION="9" 2024-04-18T05:22:35.758 INFO:teuthology.orchestra.run.smithi173.stdout:ID="centos" 2024-04-18T05:22:35.758 INFO:teuthology.orchestra.run.smithi173.stdout:ID_LIKE="rhel fedora" 2024-04-18T05:22:35.758 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_ID="9" 2024-04-18T05:22:35.758 INFO:teuthology.orchestra.run.smithi173.stdout:PLATFORM_ID="platform:el9" 2024-04-18T05:22:35.758 INFO:teuthology.orchestra.run.smithi173.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-18T05:22:35.758 INFO:teuthology.orchestra.run.smithi173.stdout:ANSI_COLOR="0;31" 2024-04-18T05:22:35.758 INFO:teuthology.orchestra.run.smithi173.stdout:LOGO="fedora-logo-icon" 2024-04-18T05:22:35.758 INFO:teuthology.orchestra.run.smithi173.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-18T05:22:35.758 INFO:teuthology.orchestra.run.smithi173.stdout:HOME_URL="https://centos.org/" 2024-04-18T05:22:35.759 INFO:teuthology.orchestra.run.smithi173.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T05:22:35.759 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-18T05:22:35.759 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-18T05:22:35.759 INFO:teuthology.provision.fog.smithi173:Deploy complete! 2024-04-18T05:22:35.759 DEBUG:teuthology.parallel:result is None 2024-04-18T05:23:04.725 WARNING:teuthology.provision.fog.smithi040:timed out 2024-04-18T05:23:10.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T05:23:10.939 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-18T05:23:10.939 DEBUG:teuthology.orchestra.run.smithi040:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-18T05:23:11.291 INFO:teuthology.provision.fog.smithi040:Node is ready 2024-04-18T05:23:11.291 DEBUG:teuthology.orchestra.run.smithi040:> hostname 2024-04-18T05:23:11.307 INFO:teuthology.orchestra.run.smithi040.stdout:smithi040.front.sepia.ceph.com 2024-04-18T05:23:11.307 DEBUG:teuthology.orchestra.run.smithi040:> grep smithi040.front.sepia.ceph.com /etc/hosts 2024-04-18T05:23:11.363 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40 smithi040.front.sepia.ceph.com smithi040 2024-04-18T05:23:11.363 DEBUG:teuthology.orchestra.run.smithi040:> sudo hostname smithi040 2024-04-18T05:23:11.476 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/smithi040.front.sepia.ceph.com/smithi040/g' /etc/hosts 2024-04-18T05:23:11.508 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/172.21.15.40/172.21.15.40/g' /etc/hosts 2024-04-18T05:23:11.581 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/smithi040.front.sepia.ceph.com/smithi040/g' /etc/hostname 2024-04-18T05:23:11.654 DEBUG:teuthology.orchestra.run.smithi040:> sudo hostname smithi040 2024-04-18T05:23:11.725 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release 2024-04-18T05:23:11.781 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="CentOS Stream" 2024-04-18T05:23:11.781 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="9" 2024-04-18T05:23:11.781 INFO:teuthology.orchestra.run.smithi040.stdout:ID="centos" 2024-04-18T05:23:11.781 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE="rhel fedora" 2024-04-18T05:23:11.781 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="9" 2024-04-18T05:23:11.781 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM_ID="platform:el9" 2024-04-18T05:23:11.781 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-18T05:23:11.781 INFO:teuthology.orchestra.run.smithi040.stdout:ANSI_COLOR="0;31" 2024-04-18T05:23:11.781 INFO:teuthology.orchestra.run.smithi040.stdout:LOGO="fedora-logo-icon" 2024-04-18T05:23:11.782 INFO:teuthology.orchestra.run.smithi040.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-18T05:23:11.782 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://centos.org/" 2024-04-18T05:23:11.782 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T05:23:11.782 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-18T05:23:11.782 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-18T05:23:11.782 INFO:teuthology.provision.fog.smithi040:Deploy complete! 2024-04-18T05:23:11.783 DEBUG:teuthology.parallel:result is None 2024-04-18T05:23:11.995 INFO:teuthology.lock.ops:Checking smithi040.front.sepia.ceph.com 2024-04-18T05:23:11.995 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-18T05:23:12.019 INFO:teuthology.lock.ops:Checking smithi070.front.sepia.ceph.com 2024-04-18T05:23:12.019 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-18T05:23:12.035 INFO:teuthology.lock.ops:Checking smithi173.front.sepia.ceph.com 2024-04-18T05:23:12.035 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-18T05:23:12.053 INFO:teuthology.lock.ops:Updating [smithi040.front.sepia.ceph.com]: set os type and version on server 2024-04-18T05:23:12.053 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-04-18T05:23:12.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T05:23:12.156 DEBUG:teuthology.orchestra.run.smithi040:> true 2024-04-18T05:23:12.226 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-04-18T05:23:12.226 DEBUG:teuthology.orchestra.run.smithi040:> uname -m 2024-04-18T05:23:12.281 INFO:teuthology.orchestra.run.smithi040.stdout:x86_64 2024-04-18T05:23:12.281 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release 2024-04-18T05:23:12.337 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="CentOS Stream" 2024-04-18T05:23:12.337 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="9" 2024-04-18T05:23:12.337 INFO:teuthology.orchestra.run.smithi040.stdout:ID="centos" 2024-04-18T05:23:12.337 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE="rhel fedora" 2024-04-18T05:23:12.337 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="9" 2024-04-18T05:23:12.338 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM_ID="platform:el9" 2024-04-18T05:23:12.338 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-18T05:23:12.338 INFO:teuthology.orchestra.run.smithi040.stdout:ANSI_COLOR="0;31" 2024-04-18T05:23:12.338 INFO:teuthology.orchestra.run.smithi040.stdout:LOGO="fedora-logo-icon" 2024-04-18T05:23:12.338 INFO:teuthology.orchestra.run.smithi040.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-18T05:23:12.338 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://centos.org/" 2024-04-18T05:23:12.338 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T05:23:12.338 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-18T05:23:12.338 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-18T05:23:12.339 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server 2024-04-18T05:23:12.361 INFO:teuthology.lock.ops:Updating [smithi070.front.sepia.ceph.com]: set os type and version on server 2024-04-18T05:23:12.361 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-04-18T05:23:12.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T05:23:12.449 DEBUG:teuthology.orchestra.run.smithi070:> true 2024-04-18T05:23:12.616 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-04-18T05:23:12.616 DEBUG:teuthology.orchestra.run.smithi070:> uname -m 2024-04-18T05:23:12.671 INFO:teuthology.orchestra.run.smithi070.stdout:x86_64 2024-04-18T05:23:12.671 DEBUG:teuthology.orchestra.run.smithi070:> cat /etc/os-release 2024-04-18T05:23:12.726 INFO:teuthology.orchestra.run.smithi070.stdout:NAME="CentOS Stream" 2024-04-18T05:23:12.726 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION="9" 2024-04-18T05:23:12.726 INFO:teuthology.orchestra.run.smithi070.stdout:ID="centos" 2024-04-18T05:23:12.726 INFO:teuthology.orchestra.run.smithi070.stdout:ID_LIKE="rhel fedora" 2024-04-18T05:23:12.726 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_ID="9" 2024-04-18T05:23:12.726 INFO:teuthology.orchestra.run.smithi070.stdout:PLATFORM_ID="platform:el9" 2024-04-18T05:23:12.726 INFO:teuthology.orchestra.run.smithi070.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-18T05:23:12.726 INFO:teuthology.orchestra.run.smithi070.stdout:ANSI_COLOR="0;31" 2024-04-18T05:23:12.726 INFO:teuthology.orchestra.run.smithi070.stdout:LOGO="fedora-logo-icon" 2024-04-18T05:23:12.726 INFO:teuthology.orchestra.run.smithi070.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-18T05:23:12.726 INFO:teuthology.orchestra.run.smithi070.stdout:HOME_URL="https://centos.org/" 2024-04-18T05:23:12.727 INFO:teuthology.orchestra.run.smithi070.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T05:23:12.727 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-18T05:23:12.727 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-18T05:23:12.727 INFO:teuthology.lock.ops:Updating smithi070.front.sepia.ceph.com on lock server 2024-04-18T05:23:12.744 INFO:teuthology.lock.ops:Updating [smithi173.front.sepia.ceph.com]: set os type and version on server 2024-04-18T05:23:12.744 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-04-18T05:23:12.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T05:23:12.830 DEBUG:teuthology.orchestra.run.smithi173:> true 2024-04-18T05:23:12.996 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-04-18T05:23:12.997 DEBUG:teuthology.orchestra.run.smithi173:> uname -m 2024-04-18T05:23:13.051 INFO:teuthology.orchestra.run.smithi173.stdout:x86_64 2024-04-18T05:23:13.051 DEBUG:teuthology.orchestra.run.smithi173:> cat /etc/os-release 2024-04-18T05:23:13.105 INFO:teuthology.orchestra.run.smithi173.stdout:NAME="CentOS Stream" 2024-04-18T05:23:13.106 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION="9" 2024-04-18T05:23:13.106 INFO:teuthology.orchestra.run.smithi173.stdout:ID="centos" 2024-04-18T05:23:13.106 INFO:teuthology.orchestra.run.smithi173.stdout:ID_LIKE="rhel fedora" 2024-04-18T05:23:13.106 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_ID="9" 2024-04-18T05:23:13.106 INFO:teuthology.orchestra.run.smithi173.stdout:PLATFORM_ID="platform:el9" 2024-04-18T05:23:13.106 INFO:teuthology.orchestra.run.smithi173.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-18T05:23:13.106 INFO:teuthology.orchestra.run.smithi173.stdout:ANSI_COLOR="0;31" 2024-04-18T05:23:13.106 INFO:teuthology.orchestra.run.smithi173.stdout:LOGO="fedora-logo-icon" 2024-04-18T05:23:13.106 INFO:teuthology.orchestra.run.smithi173.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-18T05:23:13.106 INFO:teuthology.orchestra.run.smithi173.stdout:HOME_URL="https://centos.org/" 2024-04-18T05:23:13.106 INFO:teuthology.orchestra.run.smithi173.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T05:23:13.106 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-18T05:23:13.107 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-18T05:23:13.107 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server 2024-04-18T05:23:13.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T05:23:13.203 INFO:teuthology.dispatcher.supervisor:Running job 7661786 2024-04-18T05:23:13.203 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-04-18_05:00:14-smoke-main-distro-default-smithi/7661786 --name teuthology-2024-04-18_05:00:14-smoke-main-distro-default-smithi --description smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_latest} tasks/{0-install test/rados_workunit_loadgen_mix}} -- /home/teuthworker/archive/teuthology-2024-04-18_05:00:14-smoke-main-distro-default-smithi/7661786/orig.config.yaml 2024-04-18T05:23:13.206 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-04-18_05:00:14-smoke-main-distro-default-smithi/7661786 2024-04-18T05:23:13.206 INFO:teuthology.dispatcher.supervisor:Job PID: 1581665 2024-04-18T05:23:13.206 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-18T05:25:13.282 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T05:27:13.454 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T05:29:13.600 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T05:31:13.779 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T05:31:13.860 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1