2024-04-18T09:20:27.207 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-18T09:20:27.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T09:20:27.386 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fef99b01c10>, signals=[15]) 2024-04-18T09:20:27.387 INFO:teuthology.lock.ops:Start node 'smithi066.front.sepia.ceph.com' reimaging 2024-04-18T09:20:27.387 INFO:teuthology.lock.ops:Updating [smithi066.front.sepia.ceph.com]: reset os type and version on server 2024-04-18T09:20:27.388 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server 2024-04-18T09:20:27.410 INFO:teuthology.lock.ops:Start node 'smithi130.front.sepia.ceph.com' reimaging 2024-04-18T09:20:27.410 INFO:teuthology.lock.ops:Updating [smithi130.front.sepia.ceph.com]: reset os type and version on server 2024-04-18T09:20:27.410 INFO:teuthology.lock.ops:Updating smithi130.front.sepia.ceph.com on lock server 2024-04-18T09:20:27.434 INFO:teuthology.lock.ops:Start node 'smithi137.front.sepia.ceph.com' reimaging 2024-04-18T09:20:27.435 INFO:teuthology.lock.ops:Updating [smithi137.front.sepia.ceph.com]: reset os type and version on server 2024-04-18T09:20:27.435 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server 2024-04-18T09:20:27.547 DEBUG:teuthology.provision.fog.smithi066:Requesting image smithi_centos_9.stream (ID 10) 2024-04-18T09:20:27.554 DEBUG:teuthology.provision.fog.smithi130:Requesting image smithi_centos_9.stream (ID 10) 2024-04-18T09:20:27.570 DEBUG:teuthology.provision.fog.smithi137:Requesting image smithi_centos_9.stream (ID 10) 2024-04-18T09:20:27.591 INFO:teuthology.provision.fog.smithi066:Scheduling deploy of centos 9.stream 2024-04-18T09:20:27.597 INFO:teuthology.provision.fog.smithi130:Scheduling deploy of centos 9.stream 2024-04-18T09:20:27.622 INFO:teuthology.provision.fog.smithi137:Scheduling deploy of centos 9.stream 2024-04-18T09:20:27.793 INFO:teuthology.orchestra.console.smithi130:Power off 2024-04-18T09:20:27.793 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-18T09:20:27.811 INFO:teuthology.orchestra.console.smithi066:Power off 2024-04-18T09:20:27.811 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-18T09:20:27.825 DEBUG:teuthology.orchestra.console.smithi130:power off output: Chassis Power Control: Down/Off 2024-04-18T09:20:27.825 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T09:20:27.834 DEBUG:teuthology.orchestra.console.smithi066:power off output: Chassis Power Control: Down/Off 2024-04-18T09:20:27.835 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T09:20:27.849 INFO:teuthology.orchestra.console.smithi137:Power off 2024-04-18T09:20:27.850 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-18T09:20:27.858 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is on 2024-04-18T09:20:27.859 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is on 2024-04-18T09:20:27.871 DEBUG:teuthology.orchestra.console.smithi137:power off output: Chassis Power Control: Down/Off 2024-04-18T09:20:27.872 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T09:20:27.894 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is on 2024-04-18T09:20:31.860 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T09:20:31.869 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T09:20:31.895 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T09:20:31.971 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is on 2024-04-18T09:20:31.977 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is on 2024-04-18T09:20:32.005 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is on 2024-04-18T09:20:35.974 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T09:20:35.983 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T09:20:36.006 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T09:20:36.085 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is off 2024-04-18T09:20:36.092 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is off 2024-04-18T09:20:36.114 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is on 2024-04-18T09:20:36.186 INFO:teuthology.orchestra.console.smithi066:Power off completed 2024-04-18T09:20:36.193 INFO:teuthology.orchestra.console.smithi130:Power off completed 2024-04-18T09:20:36.287 INFO:teuthology.orchestra.console.smithi066:Power on 2024-04-18T09:20:36.288 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-18T09:20:36.295 INFO:teuthology.orchestra.console.smithi130:Power on 2024-04-18T09:20:36.295 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-18T09:20:36.308 DEBUG:teuthology.orchestra.console.smithi066:power on output: Chassis Power Control: Up/On 2024-04-18T09:20:36.309 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T09:20:36.317 DEBUG:teuthology.orchestra.console.smithi130:power on output: Chassis Power Control: Up/On 2024-04-18T09:20:36.317 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T09:20:36.328 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is off 2024-04-18T09:20:36.337 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is off 2024-04-18T09:20:40.119 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T09:20:40.229 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is off 2024-04-18T09:20:40.329 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T09:20:40.336 INFO:teuthology.orchestra.console.smithi137:Power off completed 2024-04-18T09:20:40.338 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T09:20:40.437 INFO:teuthology.orchestra.console.smithi137:Power on 2024-04-18T09:20:40.437 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-18T09:20:40.447 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is off 2024-04-18T09:20:40.447 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is off 2024-04-18T09:20:40.459 DEBUG:teuthology.orchestra.console.smithi137:power on output: Chassis Power Control: Up/On 2024-04-18T09:20:40.459 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T09:20:40.482 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is off 2024-04-18T09:20:44.450 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T09:20:44.457 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T09:20:44.484 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T09:20:44.567 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is on 2024-04-18T09:20:44.594 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is on 2024-04-18T09:20:44.660 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is on 2024-04-18T09:20:44.668 INFO:teuthology.orchestra.console.smithi130:Power on completed 2024-04-18T09:20:44.695 INFO:teuthology.orchestra.console.smithi137:Power on completed 2024-04-18T09:20:44.761 INFO:teuthology.orchestra.console.smithi066:Power on completed 2024-04-18T09:20:44.769 INFO:teuthology.provision.fog.smithi130:Waiting for deploy to finish 2024-04-18T09:20:44.797 INFO:teuthology.provision.fog.smithi137:Waiting for deploy to finish 2024-04-18T09:20:44.862 INFO:teuthology.provision.fog.smithi066:Waiting for deploy to finish 2024-04-18T09:23:15.585 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:23:15.591 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:23:18.655 WARNING:teuthology.provision.fog.smithi130:[Errno None] Unable to connect to port 22 on 172.21.15.130 2024-04-18T09:23:18.655 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2024-04-18T09:23:24.659 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:23:24.661 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:23:27.710 WARNING:teuthology.provision.fog.smithi130:[Errno None] Unable to connect to port 22 on 172.21.15.130 2024-04-18T09:23:27.742 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2024-04-18T09:23:33.715 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:23:33.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:23:36.770 WARNING:teuthology.provision.fog.smithi130:[Errno None] Unable to connect to port 22 on 172.21.15.130 2024-04-18T09:23:36.798 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2024-04-18T09:23:42.777 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:23:42.799 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:23:45.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:23:45.858 WARNING:teuthology.provision.fog.smithi130:[Errno None] Unable to connect to port 22 on 172.21.15.130 2024-04-18T09:23:45.866 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2024-04-18T09:23:48.770 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-04-18T09:23:51.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:23:51.873 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:23:54.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:23:54.942 WARNING:teuthology.provision.fog.smithi130:[Errno None] Unable to connect to port 22 on 172.21.15.130 2024-04-18T09:23:54.943 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2024-04-18T09:23:57.854 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-04-18T09:24:00.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:24:00.946 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:24:03.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:24:03.998 WARNING:teuthology.provision.fog.smithi130:[Errno None] Unable to connect to port 22 on 172.21.15.130 2024-04-18T09:24:03.999 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2024-04-18T09:24:06.914 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-04-18T09:24:10.003 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:24:10.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:24:12.923 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:24:13.090 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2024-04-18T09:24:16.007 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-04-18T09:24:19.094 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:24:22.010 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:24:25.086 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-04-18T09:24:28.323 WARNING:teuthology.provision.fog.smithi130:[Errno None] Unable to connect to port 22 on 172.21.15.130 2024-04-18T09:24:31.088 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:24:34.142 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-04-18T09:24:34.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:24:37.406 WARNING:teuthology.provision.fog.smithi130:[Errno None] Unable to connect to port 22 on 172.21.15.130 2024-04-18T09:24:37.534 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2024-04-18T09:24:40.145 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:24:43.205 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-04-18T09:24:43.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:24:43.535 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:24:46.466 WARNING:teuthology.provision.fog.smithi130:[Errno None] Unable to connect to port 22 on 172.21.15.130 2024-04-18T09:24:46.590 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2024-04-18T09:24:49.207 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:24:52.286 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-04-18T09:24:52.468 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:24:52.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:24:52.702 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-18T09:24:52.702 DEBUG:teuthology.orchestra.run.smithi130:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-18T09:24:55.646 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2024-04-18T09:24:58.287 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:25:01.350 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-04-18T09:25:01.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:25:02.066 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-18T09:25:02.067 DEBUG:teuthology.orchestra.run.smithi137:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-18T09:25:07.352 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:25:08.085 INFO:teuthology.provision.fog.smithi130:Node is ready 2024-04-18T09:25:08.085 DEBUG:teuthology.orchestra.run.smithi130:> hostname 2024-04-18T09:25:08.103 INFO:teuthology.orchestra.run.smithi130.stdout:smithi046 2024-04-18T09:25:08.103 DEBUG:teuthology.orchestra.run.smithi130:> grep smithi046 /etc/hosts 2024-04-18T09:25:08.161 INFO:teuthology.orchestra.run.smithi130.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2024-04-18T09:25:08.161 DEBUG:teuthology.orchestra.run.smithi130:> sudo hostname smithi130 2024-04-18T09:25:08.304 DEBUG:teuthology.orchestra.run.smithi130:> sudo sed -i -e 's/smithi046/smithi130/g' /etc/hosts 2024-04-18T09:25:08.335 DEBUG:teuthology.orchestra.run.smithi130:> sudo sed -i -e 's/172.21.15.46/172.21.15.130/g' /etc/hosts 2024-04-18T09:25:08.406 DEBUG:teuthology.orchestra.run.smithi130:> sudo sed -i -e 's/smithi046/smithi130/g' /etc/hostname 2024-04-18T09:25:08.476 DEBUG:teuthology.orchestra.run.smithi130:> sudo hostname smithi130 2024-04-18T09:25:08.545 DEBUG:teuthology.orchestra.run.smithi130:> cat /etc/os-release 2024-04-18T09:25:08.602 INFO:teuthology.orchestra.run.smithi130.stdout:NAME="CentOS Stream" 2024-04-18T09:25:08.602 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION="9" 2024-04-18T09:25:08.602 INFO:teuthology.orchestra.run.smithi130.stdout:ID="centos" 2024-04-18T09:25:08.602 INFO:teuthology.orchestra.run.smithi130.stdout:ID_LIKE="rhel fedora" 2024-04-18T09:25:08.602 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION_ID="9" 2024-04-18T09:25:08.602 INFO:teuthology.orchestra.run.smithi130.stdout:PLATFORM_ID="platform:el9" 2024-04-18T09:25:08.602 INFO:teuthology.orchestra.run.smithi130.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-18T09:25:08.602 INFO:teuthology.orchestra.run.smithi130.stdout:ANSI_COLOR="0;31" 2024-04-18T09:25:08.602 INFO:teuthology.orchestra.run.smithi130.stdout:LOGO="fedora-logo-icon" 2024-04-18T09:25:08.602 INFO:teuthology.orchestra.run.smithi130.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-18T09:25:08.603 INFO:teuthology.orchestra.run.smithi130.stdout:HOME_URL="https://centos.org/" 2024-04-18T09:25:08.603 INFO:teuthology.orchestra.run.smithi130.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T09:25:08.603 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-18T09:25:08.603 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-18T09:25:08.604 INFO:teuthology.provision.fog.smithi130:Deploy complete! 2024-04-18T09:25:08.605 DEBUG:teuthology.parallel:result is None 2024-04-18T09:25:17.384 INFO:teuthology.provision.fog.smithi137:Node is ready 2024-04-18T09:25:17.384 DEBUG:teuthology.orchestra.run.smithi137:> hostname 2024-04-18T09:25:17.402 INFO:teuthology.orchestra.run.smithi137.stdout:smithi046 2024-04-18T09:25:17.402 DEBUG:teuthology.orchestra.run.smithi137:> grep smithi046 /etc/hosts 2024-04-18T09:25:17.460 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2024-04-18T09:25:17.460 DEBUG:teuthology.orchestra.run.smithi137:> sudo hostname smithi137 2024-04-18T09:25:17.608 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i -e 's/smithi046/smithi137/g' /etc/hosts 2024-04-18T09:25:17.639 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i -e 's/172.21.15.46/172.21.15.137/g' /etc/hosts 2024-04-18T09:25:17.709 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i -e 's/smithi046/smithi137/g' /etc/hostname 2024-04-18T09:25:17.777 DEBUG:teuthology.orchestra.run.smithi137:> sudo hostname smithi137 2024-04-18T09:25:17.844 DEBUG:teuthology.orchestra.run.smithi137:> cat /etc/os-release 2024-04-18T09:25:17.899 INFO:teuthology.orchestra.run.smithi137.stdout:NAME="CentOS Stream" 2024-04-18T09:25:17.899 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION="9" 2024-04-18T09:25:17.899 INFO:teuthology.orchestra.run.smithi137.stdout:ID="centos" 2024-04-18T09:25:17.899 INFO:teuthology.orchestra.run.smithi137.stdout:ID_LIKE="rhel fedora" 2024-04-18T09:25:17.899 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_ID="9" 2024-04-18T09:25:17.900 INFO:teuthology.orchestra.run.smithi137.stdout:PLATFORM_ID="platform:el9" 2024-04-18T09:25:17.900 INFO:teuthology.orchestra.run.smithi137.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-18T09:25:17.900 INFO:teuthology.orchestra.run.smithi137.stdout:ANSI_COLOR="0;31" 2024-04-18T09:25:17.900 INFO:teuthology.orchestra.run.smithi137.stdout:LOGO="fedora-logo-icon" 2024-04-18T09:25:17.900 INFO:teuthology.orchestra.run.smithi137.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-18T09:25:17.900 INFO:teuthology.orchestra.run.smithi137.stdout:HOME_URL="https://centos.org/" 2024-04-18T09:25:17.900 INFO:teuthology.orchestra.run.smithi137.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T09:25:17.900 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-18T09:25:17.900 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-18T09:25:17.900 INFO:teuthology.provision.fog.smithi137:Deploy complete! 2024-04-18T09:25:17.901 DEBUG:teuthology.parallel:result is None 2024-04-18T09:26:07.355 WARNING:teuthology.provision.fog.smithi066:timed out 2024-04-18T09:26:13.357 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:26:13.601 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-18T09:26:13.601 DEBUG:teuthology.orchestra.run.smithi066:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-18T09:26:13.932 INFO:teuthology.provision.fog.smithi066:Node is ready 2024-04-18T09:26:13.933 DEBUG:teuthology.orchestra.run.smithi066:> hostname 2024-04-18T09:26:13.948 INFO:teuthology.orchestra.run.smithi066.stdout:smithi066.front.sepia.ceph.com 2024-04-18T09:26:13.950 DEBUG:teuthology.orchestra.run.smithi066:> grep smithi066.front.sepia.ceph.com /etc/hosts 2024-04-18T09:26:14.004 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66 smithi066.front.sepia.ceph.com smithi066 2024-04-18T09:26:14.005 DEBUG:teuthology.orchestra.run.smithi066:> sudo hostname smithi066 2024-04-18T09:26:14.107 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i -e 's/smithi066.front.sepia.ceph.com/smithi066/g' /etc/hosts 2024-04-18T09:26:14.138 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i -e 's/172.21.15.66/172.21.15.66/g' /etc/hosts 2024-04-18T09:26:14.209 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i -e 's/smithi066.front.sepia.ceph.com/smithi066/g' /etc/hostname 2024-04-18T09:26:14.280 DEBUG:teuthology.orchestra.run.smithi066:> sudo hostname smithi066 2024-04-18T09:26:14.351 DEBUG:teuthology.orchestra.run.smithi066:> cat /etc/os-release 2024-04-18T09:26:14.410 INFO:teuthology.orchestra.run.smithi066.stdout:NAME="CentOS Stream" 2024-04-18T09:26:14.410 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION="9" 2024-04-18T09:26:14.410 INFO:teuthology.orchestra.run.smithi066.stdout:ID="centos" 2024-04-18T09:26:14.410 INFO:teuthology.orchestra.run.smithi066.stdout:ID_LIKE="rhel fedora" 2024-04-18T09:26:14.410 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_ID="9" 2024-04-18T09:26:14.410 INFO:teuthology.orchestra.run.smithi066.stdout:PLATFORM_ID="platform:el9" 2024-04-18T09:26:14.410 INFO:teuthology.orchestra.run.smithi066.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-18T09:26:14.410 INFO:teuthology.orchestra.run.smithi066.stdout:ANSI_COLOR="0;31" 2024-04-18T09:26:14.411 INFO:teuthology.orchestra.run.smithi066.stdout:LOGO="fedora-logo-icon" 2024-04-18T09:26:14.411 INFO:teuthology.orchestra.run.smithi066.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-18T09:26:14.411 INFO:teuthology.orchestra.run.smithi066.stdout:HOME_URL="https://centos.org/" 2024-04-18T09:26:14.411 INFO:teuthology.orchestra.run.smithi066.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T09:26:14.411 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-18T09:26:14.411 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-18T09:26:14.411 INFO:teuthology.provision.fog.smithi066:Deploy complete! 2024-04-18T09:26:14.412 DEBUG:teuthology.parallel:result is None 2024-04-18T09:26:14.676 INFO:teuthology.lock.ops:Checking smithi066.front.sepia.ceph.com 2024-04-18T09:26:14.677 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-18T09:26:14.708 INFO:teuthology.lock.ops:Checking smithi130.front.sepia.ceph.com 2024-04-18T09:26:14.708 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-18T09:26:14.725 INFO:teuthology.lock.ops:Checking smithi137.front.sepia.ceph.com 2024-04-18T09:26:14.725 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-18T09:26:14.744 INFO:teuthology.lock.ops:Updating [smithi066.front.sepia.ceph.com]: set os type and version on server 2024-04-18T09:26:14.745 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-04-18T09:26:14.745 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:26:14.856 DEBUG:teuthology.orchestra.run.smithi066:> true 2024-04-18T09:26:14.920 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-04-18T09:26:14.921 DEBUG:teuthology.orchestra.run.smithi066:> uname -m 2024-04-18T09:26:14.976 INFO:teuthology.orchestra.run.smithi066.stdout:x86_64 2024-04-18T09:26:14.977 DEBUG:teuthology.orchestra.run.smithi066:> cat /etc/os-release 2024-04-18T09:26:15.032 INFO:teuthology.orchestra.run.smithi066.stdout:NAME="CentOS Stream" 2024-04-18T09:26:15.032 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION="9" 2024-04-18T09:26:15.032 INFO:teuthology.orchestra.run.smithi066.stdout:ID="centos" 2024-04-18T09:26:15.032 INFO:teuthology.orchestra.run.smithi066.stdout:ID_LIKE="rhel fedora" 2024-04-18T09:26:15.032 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_ID="9" 2024-04-18T09:26:15.032 INFO:teuthology.orchestra.run.smithi066.stdout:PLATFORM_ID="platform:el9" 2024-04-18T09:26:15.032 INFO:teuthology.orchestra.run.smithi066.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-18T09:26:15.032 INFO:teuthology.orchestra.run.smithi066.stdout:ANSI_COLOR="0;31" 2024-04-18T09:26:15.032 INFO:teuthology.orchestra.run.smithi066.stdout:LOGO="fedora-logo-icon" 2024-04-18T09:26:15.033 INFO:teuthology.orchestra.run.smithi066.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-18T09:26:15.033 INFO:teuthology.orchestra.run.smithi066.stdout:HOME_URL="https://centos.org/" 2024-04-18T09:26:15.033 INFO:teuthology.orchestra.run.smithi066.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T09:26:15.033 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-18T09:26:15.033 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-18T09:26:15.033 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server 2024-04-18T09:26:15.060 INFO:teuthology.lock.ops:Updating [smithi130.front.sepia.ceph.com]: set os type and version on server 2024-04-18T09:26:15.060 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-04-18T09:26:15.061 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:26:15.150 DEBUG:teuthology.orchestra.run.smithi130:> true 2024-04-18T09:26:15.321 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-04-18T09:26:15.321 DEBUG:teuthology.orchestra.run.smithi130:> uname -m 2024-04-18T09:26:15.375 INFO:teuthology.orchestra.run.smithi130.stdout:x86_64 2024-04-18T09:26:15.376 DEBUG:teuthology.orchestra.run.smithi130:> cat /etc/os-release 2024-04-18T09:26:15.430 INFO:teuthology.orchestra.run.smithi130.stdout:NAME="CentOS Stream" 2024-04-18T09:26:15.430 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION="9" 2024-04-18T09:26:15.430 INFO:teuthology.orchestra.run.smithi130.stdout:ID="centos" 2024-04-18T09:26:15.430 INFO:teuthology.orchestra.run.smithi130.stdout:ID_LIKE="rhel fedora" 2024-04-18T09:26:15.431 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION_ID="9" 2024-04-18T09:26:15.431 INFO:teuthology.orchestra.run.smithi130.stdout:PLATFORM_ID="platform:el9" 2024-04-18T09:26:15.431 INFO:teuthology.orchestra.run.smithi130.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-18T09:26:15.431 INFO:teuthology.orchestra.run.smithi130.stdout:ANSI_COLOR="0;31" 2024-04-18T09:26:15.431 INFO:teuthology.orchestra.run.smithi130.stdout:LOGO="fedora-logo-icon" 2024-04-18T09:26:15.431 INFO:teuthology.orchestra.run.smithi130.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-18T09:26:15.431 INFO:teuthology.orchestra.run.smithi130.stdout:HOME_URL="https://centos.org/" 2024-04-18T09:26:15.431 INFO:teuthology.orchestra.run.smithi130.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T09:26:15.431 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-18T09:26:15.431 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-18T09:26:15.432 INFO:teuthology.lock.ops:Updating smithi130.front.sepia.ceph.com on lock server 2024-04-18T09:26:15.459 INFO:teuthology.lock.ops:Updating [smithi137.front.sepia.ceph.com]: set os type and version on server 2024-04-18T09:26:15.459 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-04-18T09:26:15.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T09:26:15.559 DEBUG:teuthology.orchestra.run.smithi137:> true 2024-04-18T09:26:15.623 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-04-18T09:26:15.623 DEBUG:teuthology.orchestra.run.smithi137:> uname -m 2024-04-18T09:26:15.679 INFO:teuthology.orchestra.run.smithi137.stdout:x86_64 2024-04-18T09:26:15.679 DEBUG:teuthology.orchestra.run.smithi137:> cat /etc/os-release 2024-04-18T09:26:15.735 INFO:teuthology.orchestra.run.smithi137.stdout:NAME="CentOS Stream" 2024-04-18T09:26:15.735 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION="9" 2024-04-18T09:26:15.735 INFO:teuthology.orchestra.run.smithi137.stdout:ID="centos" 2024-04-18T09:26:15.735 INFO:teuthology.orchestra.run.smithi137.stdout:ID_LIKE="rhel fedora" 2024-04-18T09:26:15.735 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_ID="9" 2024-04-18T09:26:15.735 INFO:teuthology.orchestra.run.smithi137.stdout:PLATFORM_ID="platform:el9" 2024-04-18T09:26:15.735 INFO:teuthology.orchestra.run.smithi137.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-18T09:26:15.736 INFO:teuthology.orchestra.run.smithi137.stdout:ANSI_COLOR="0;31" 2024-04-18T09:26:15.736 INFO:teuthology.orchestra.run.smithi137.stdout:LOGO="fedora-logo-icon" 2024-04-18T09:26:15.736 INFO:teuthology.orchestra.run.smithi137.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-18T09:26:15.736 INFO:teuthology.orchestra.run.smithi137.stdout:HOME_URL="https://centos.org/" 2024-04-18T09:26:15.736 INFO:teuthology.orchestra.run.smithi137.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T09:26:15.736 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-18T09:26:15.736 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-18T09:26:15.736 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server 2024-04-18T09:26:15.759 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T09:26:15.883 INFO:teuthology.dispatcher.supervisor:Running job 7660887 2024-04-18T09:26:15.884 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-04-17_20:24:14-fs-main-distro-default-smithi/7660887 --name teuthology-2024-04-17_20:24:14-fs-main-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/direct_io}} -- /home/teuthworker/archive/teuthology-2024-04-17_20:24:14-fs-main-distro-default-smithi/7660887/orig.config.yaml 2024-04-18T09:26:15.897 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-04-17_20:24:14-fs-main-distro-default-smithi/7660887 2024-04-18T09:26:15.897 INFO:teuthology.dispatcher.supervisor:Job PID: 3013156 2024-04-18T09:26:15.898 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-18T09:28:15.999 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T09:30:16.215 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T09:32:16.375 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T09:34:16.547 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T09:36:16.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T09:36:16.793 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1