2024-03-21T16:05:00.103 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-21T16:05:00.103 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:05:00.282 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb73577cc10>, signals=[15]) 2024-03-21T16:05:00.282 INFO:teuthology.lock.ops:Start node 'smithi007.front.sepia.ceph.com' reimaging 2024-03-21T16:05:00.283 INFO:teuthology.lock.ops:Updating [smithi007.front.sepia.ceph.com]: reset os type and version on server 2024-03-21T16:05:00.283 INFO:teuthology.lock.ops:Updating smithi007.front.sepia.ceph.com on lock server 2024-03-21T16:05:00.307 INFO:teuthology.lock.ops:Start node 'smithi064.front.sepia.ceph.com' reimaging 2024-03-21T16:05:00.307 INFO:teuthology.lock.ops:Updating [smithi064.front.sepia.ceph.com]: reset os type and version on server 2024-03-21T16:05:00.307 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server 2024-03-21T16:05:00.332 INFO:teuthology.lock.ops:Start node 'smithi120.front.sepia.ceph.com' reimaging 2024-03-21T16:05:00.332 INFO:teuthology.lock.ops:Updating [smithi120.front.sepia.ceph.com]: reset os type and version on server 2024-03-21T16:05:00.332 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server 2024-03-21T16:05:00.425 DEBUG:teuthology.provision.fog.smithi007:Requesting image smithi_centos_9.stream (ID 10) 2024-03-21T16:05:00.448 DEBUG:teuthology.provision.fog.smithi064:Requesting image smithi_centos_9.stream (ID 10) 2024-03-21T16:05:00.466 DEBUG:teuthology.provision.fog.smithi120:Requesting image smithi_centos_9.stream (ID 10) 2024-03-21T16:05:00.470 INFO:teuthology.provision.fog.smithi007:Scheduling deploy of centos 9.stream 2024-03-21T16:05:00.505 INFO:teuthology.provision.fog.smithi064:Scheduling deploy of centos 9.stream 2024-03-21T16:05:00.509 INFO:teuthology.provision.fog.smithi120:Scheduling deploy of centos 9.stream 2024-03-21T16:05:00.778 INFO:teuthology.orchestra.console.smithi064:Power off 2024-03-21T16:05:00.778 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-21T16:05:00.792 INFO:teuthology.orchestra.console.smithi007:Power off 2024-03-21T16:05:00.793 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-21T16:05:00.804 INFO:teuthology.orchestra.console.smithi120:Power off 2024-03-21T16:05:00.805 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-21T16:05:00.813 DEBUG:teuthology.orchestra.console.smithi064:power off output: Chassis Power Control: Down/Off 2024-03-21T16:05:00.813 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T16:05:00.821 DEBUG:teuthology.orchestra.console.smithi007:power off output: Chassis Power Control: Down/Off 2024-03-21T16:05:00.821 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T16:05:00.830 DEBUG:teuthology.orchestra.console.smithi120:power off output: Chassis Power Control: Down/Off 2024-03-21T16:05:00.830 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T16:05:00.840 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off 2024-03-21T16:05:00.847 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is off 2024-03-21T16:05:00.853 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is off 2024-03-21T16:05:00.941 INFO:teuthology.orchestra.console.smithi064:Power off completed 2024-03-21T16:05:00.949 INFO:teuthology.orchestra.console.smithi007:Power off completed 2024-03-21T16:05:00.953 INFO:teuthology.orchestra.console.smithi120:Power off completed 2024-03-21T16:05:01.043 INFO:teuthology.orchestra.console.smithi064:Power on 2024-03-21T16:05:01.043 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-21T16:05:01.050 INFO:teuthology.orchestra.console.smithi007:Power on 2024-03-21T16:05:01.051 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-21T16:05:01.057 INFO:teuthology.orchestra.console.smithi120:Power on 2024-03-21T16:05:01.058 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-21T16:05:01.067 DEBUG:teuthology.orchestra.console.smithi064:power on output: Chassis Power Control: Up/On 2024-03-21T16:05:01.067 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T16:05:01.079 DEBUG:teuthology.orchestra.console.smithi007:power on output: Chassis Power Control: Up/On 2024-03-21T16:05:01.079 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T16:05:01.087 DEBUG:teuthology.orchestra.console.smithi120:power on output: Chassis Power Control: Up/On 2024-03-21T16:05:01.088 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T16:05:01.101 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off 2024-03-21T16:05:01.104 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is off 2024-03-21T16:05:01.116 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is off 2024-03-21T16:05:05.106 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T16:05:05.113 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T16:05:05.120 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T16:05:05.216 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2024-03-21T16:05:05.222 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is on 2024-03-21T16:05:05.229 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is off 2024-03-21T16:05:05.317 INFO:teuthology.orchestra.console.smithi064:Power on completed 2024-03-21T16:05:05.322 INFO:teuthology.orchestra.console.smithi007:Power on completed 2024-03-21T16:05:05.418 INFO:teuthology.provision.fog.smithi064:Waiting for deploy to finish 2024-03-21T16:05:05.423 INFO:teuthology.provision.fog.smithi007:Waiting for deploy to finish 2024-03-21T16:05:09.231 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-21T16:05:09.340 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is on 2024-03-21T16:05:09.441 INFO:teuthology.orchestra.console.smithi120:Power on completed 2024-03-21T16:05:09.542 INFO:teuthology.provision.fog.smithi120:Waiting for deploy to finish 2024-03-21T16:07:36.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T16:07:39.358 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7 2024-03-21T16:07:40.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T16:07:43.390 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-03-21T16:07:45.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T16:07:48.414 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7 2024-03-21T16:07:49.392 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T16:07:51.330 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T16:07:52.446 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-03-21T16:07:54.398 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2024-03-21T16:07:54.416 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T16:07:57.470 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7 2024-03-21T16:07:58.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T16:08:00.402 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T16:08:01.506 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-03-21T16:08:03.454 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2024-03-21T16:08:03.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T16:08:06.526 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7 2024-03-21T16:08:07.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T16:08:09.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T16:08:10.590 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-03-21T16:08:12.510 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2024-03-21T16:08:12.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T16:08:15.582 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7 2024-03-21T16:08:16.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T16:08:18.513 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T16:08:19.646 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-03-21T16:08:21.566 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2024-03-21T16:08:21.583 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T16:08:25.651 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T16:08:27.570 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T16:08:28.702 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-03-21T16:08:30.622 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2024-03-21T16:08:34.707 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T16:08:36.625 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T16:08:39.678 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2024-03-21T16:08:45.681 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T16:09:21.619 WARNING:teuthology.provision.fog.smithi007:timed out 2024-03-21T16:09:27.625 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T16:09:27.893 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-21T16:09:27.893 DEBUG:teuthology.orchestra.run.smithi007:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-21T16:09:28.229 INFO:teuthology.provision.fog.smithi007:Node is ready 2024-03-21T16:09:28.229 DEBUG:teuthology.orchestra.run.smithi007:> hostname 2024-03-21T16:09:28.244 INFO:teuthology.orchestra.run.smithi007.stdout:smithi007.front.sepia.ceph.com 2024-03-21T16:09:28.245 DEBUG:teuthology.orchestra.run.smithi007:> grep smithi007.front.sepia.ceph.com /etc/hosts 2024-03-21T16:09:28.301 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7 smithi007.front.sepia.ceph.com smithi007 2024-03-21T16:09:28.301 DEBUG:teuthology.orchestra.run.smithi007:> sudo hostname smithi007 2024-03-21T16:09:28.407 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i -e 's/smithi007.front.sepia.ceph.com/smithi007/g' /etc/hosts 2024-03-21T16:09:28.438 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i -e 's/172.21.15.7/172.21.15.7/g' /etc/hosts 2024-03-21T16:09:28.509 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i -e 's/smithi007.front.sepia.ceph.com/smithi007/g' /etc/hostname 2024-03-21T16:09:28.580 DEBUG:teuthology.orchestra.run.smithi007:> sudo hostname smithi007 2024-03-21T16:09:28.651 DEBUG:teuthology.orchestra.run.smithi007:> cat /etc/os-release 2024-03-21T16:09:28.705 INFO:teuthology.orchestra.run.smithi007.stdout:NAME="CentOS Stream" 2024-03-21T16:09:28.706 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION="9" 2024-03-21T16:09:28.706 INFO:teuthology.orchestra.run.smithi007.stdout:ID="centos" 2024-03-21T16:09:28.706 INFO:teuthology.orchestra.run.smithi007.stdout:ID_LIKE="rhel fedora" 2024-03-21T16:09:28.706 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_ID="9" 2024-03-21T16:09:28.706 INFO:teuthology.orchestra.run.smithi007.stdout:PLATFORM_ID="platform:el9" 2024-03-21T16:09:28.706 INFO:teuthology.orchestra.run.smithi007.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-21T16:09:28.706 INFO:teuthology.orchestra.run.smithi007.stdout:ANSI_COLOR="0;31" 2024-03-21T16:09:28.706 INFO:teuthology.orchestra.run.smithi007.stdout:LOGO="fedora-logo-icon" 2024-03-21T16:09:28.706 INFO:teuthology.orchestra.run.smithi007.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-21T16:09:28.706 INFO:teuthology.orchestra.run.smithi007.stdout:HOME_URL="https://centos.org/" 2024-03-21T16:09:28.706 INFO:teuthology.orchestra.run.smithi007.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-21T16:09:28.707 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-21T16:09:28.707 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-21T16:09:28.707 INFO:teuthology.provision.fog.smithi007:Deploy complete! 2024-03-21T16:09:28.709 DEBUG:teuthology.parallel:result is None 2024-03-21T16:09:34.714 WARNING:teuthology.provision.fog.smithi120:timed out 2024-03-21T16:09:40.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T16:09:40.984 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-21T16:09:40.984 DEBUG:teuthology.orchestra.run.smithi120:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-21T16:09:41.329 INFO:teuthology.provision.fog.smithi120:Node is ready 2024-03-21T16:09:41.329 DEBUG:teuthology.orchestra.run.smithi120:> hostname 2024-03-21T16:09:41.343 INFO:teuthology.orchestra.run.smithi120.stdout:smithi120.front.sepia.ceph.com 2024-03-21T16:09:41.343 DEBUG:teuthology.orchestra.run.smithi120:> grep smithi120.front.sepia.ceph.com /etc/hosts 2024-03-21T16:09:41.397 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120 smithi120.front.sepia.ceph.com smithi120 2024-03-21T16:09:41.398 DEBUG:teuthology.orchestra.run.smithi120:> sudo hostname smithi120 2024-03-21T16:09:41.523 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i -e 's/smithi120.front.sepia.ceph.com/smithi120/g' /etc/hosts 2024-03-21T16:09:41.550 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i -e 's/172.21.15.120/172.21.15.120/g' /etc/hosts 2024-03-21T16:09:41.618 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i -e 's/smithi120.front.sepia.ceph.com/smithi120/g' /etc/hostname 2024-03-21T16:09:41.686 DEBUG:teuthology.orchestra.run.smithi120:> sudo hostname smithi120 2024-03-21T16:09:41.752 DEBUG:teuthology.orchestra.run.smithi120:> cat /etc/os-release 2024-03-21T16:09:41.807 INFO:teuthology.orchestra.run.smithi120.stdout:NAME="CentOS Stream" 2024-03-21T16:09:41.807 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION="9" 2024-03-21T16:09:41.807 INFO:teuthology.orchestra.run.smithi120.stdout:ID="centos" 2024-03-21T16:09:41.808 INFO:teuthology.orchestra.run.smithi120.stdout:ID_LIKE="rhel fedora" 2024-03-21T16:09:41.808 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_ID="9" 2024-03-21T16:09:41.808 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM_ID="platform:el9" 2024-03-21T16:09:41.808 INFO:teuthology.orchestra.run.smithi120.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-21T16:09:41.808 INFO:teuthology.orchestra.run.smithi120.stdout:ANSI_COLOR="0;31" 2024-03-21T16:09:41.808 INFO:teuthology.orchestra.run.smithi120.stdout:LOGO="fedora-logo-icon" 2024-03-21T16:09:41.808 INFO:teuthology.orchestra.run.smithi120.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-21T16:09:41.808 INFO:teuthology.orchestra.run.smithi120.stdout:HOME_URL="https://centos.org/" 2024-03-21T16:09:41.808 INFO:teuthology.orchestra.run.smithi120.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-21T16:09:41.808 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-21T16:09:41.808 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-21T16:09:41.808 INFO:teuthology.provision.fog.smithi120:Deploy complete! 2024-03-21T16:09:41.809 DEBUG:teuthology.parallel:result is None 2024-03-21T16:09:45.687 WARNING:teuthology.provision.fog.smithi064:timed out 2024-03-21T16:09:51.694 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T16:09:51.944 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-21T16:09:51.944 DEBUG:teuthology.orchestra.run.smithi064:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-21T16:09:52.305 INFO:teuthology.provision.fog.smithi064:Node is ready 2024-03-21T16:09:52.306 DEBUG:teuthology.orchestra.run.smithi064:> hostname 2024-03-21T16:09:52.322 INFO:teuthology.orchestra.run.smithi064.stdout:smithi064.front.sepia.ceph.com 2024-03-21T16:09:52.322 DEBUG:teuthology.orchestra.run.smithi064:> grep smithi064.front.sepia.ceph.com /etc/hosts 2024-03-21T16:09:52.379 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64 smithi064.front.sepia.ceph.com smithi064 2024-03-21T16:09:52.379 DEBUG:teuthology.orchestra.run.smithi064:> sudo hostname smithi064 2024-03-21T16:09:52.494 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/smithi064.front.sepia.ceph.com/smithi064/g' /etc/hosts 2024-03-21T16:09:52.528 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/172.21.15.64/172.21.15.64/g' /etc/hosts 2024-03-21T16:09:52.602 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/smithi064.front.sepia.ceph.com/smithi064/g' /etc/hostname 2024-03-21T16:09:52.676 DEBUG:teuthology.orchestra.run.smithi064:> sudo hostname smithi064 2024-03-21T16:09:52.747 DEBUG:teuthology.orchestra.run.smithi064:> cat /etc/os-release 2024-03-21T16:09:52.803 INFO:teuthology.orchestra.run.smithi064.stdout:NAME="CentOS Stream" 2024-03-21T16:09:52.803 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION="9" 2024-03-21T16:09:52.803 INFO:teuthology.orchestra.run.smithi064.stdout:ID="centos" 2024-03-21T16:09:52.803 INFO:teuthology.orchestra.run.smithi064.stdout:ID_LIKE="rhel fedora" 2024-03-21T16:09:52.803 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_ID="9" 2024-03-21T16:09:52.803 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM_ID="platform:el9" 2024-03-21T16:09:52.803 INFO:teuthology.orchestra.run.smithi064.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-21T16:09:52.803 INFO:teuthology.orchestra.run.smithi064.stdout:ANSI_COLOR="0;31" 2024-03-21T16:09:52.803 INFO:teuthology.orchestra.run.smithi064.stdout:LOGO="fedora-logo-icon" 2024-03-21T16:09:52.803 INFO:teuthology.orchestra.run.smithi064.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-21T16:09:52.803 INFO:teuthology.orchestra.run.smithi064.stdout:HOME_URL="https://centos.org/" 2024-03-21T16:09:52.803 INFO:teuthology.orchestra.run.smithi064.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-21T16:09:52.803 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-21T16:09:52.804 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-21T16:09:52.804 INFO:teuthology.provision.fog.smithi064:Deploy complete! 2024-03-21T16:09:52.804 DEBUG:teuthology.parallel:result is None 2024-03-21T16:09:53.024 INFO:teuthology.lock.ops:Checking smithi007.front.sepia.ceph.com 2024-03-21T16:09:53.024 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-21T16:09:53.047 INFO:teuthology.lock.ops:Checking smithi064.front.sepia.ceph.com 2024-03-21T16:09:53.047 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-21T16:09:53.063 INFO:teuthology.lock.ops:Checking smithi120.front.sepia.ceph.com 2024-03-21T16:09:53.063 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-21T16:09:53.081 INFO:teuthology.lock.ops:Updating [smithi007.front.sepia.ceph.com]: set os type and version on server 2024-03-21T16:09:53.081 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-03-21T16:09:53.082 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T16:09:53.188 DEBUG:teuthology.orchestra.run.smithi007:> true 2024-03-21T16:09:53.368 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-03-21T16:09:53.369 DEBUG:teuthology.orchestra.run.smithi007:> uname -m 2024-03-21T16:09:53.423 INFO:teuthology.orchestra.run.smithi007.stdout:x86_64 2024-03-21T16:09:53.423 DEBUG:teuthology.orchestra.run.smithi007:> cat /etc/os-release 2024-03-21T16:09:53.478 INFO:teuthology.orchestra.run.smithi007.stdout:NAME="CentOS Stream" 2024-03-21T16:09:53.478 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION="9" 2024-03-21T16:09:53.478 INFO:teuthology.orchestra.run.smithi007.stdout:ID="centos" 2024-03-21T16:09:53.478 INFO:teuthology.orchestra.run.smithi007.stdout:ID_LIKE="rhel fedora" 2024-03-21T16:09:53.479 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_ID="9" 2024-03-21T16:09:53.479 INFO:teuthology.orchestra.run.smithi007.stdout:PLATFORM_ID="platform:el9" 2024-03-21T16:09:53.479 INFO:teuthology.orchestra.run.smithi007.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-21T16:09:53.479 INFO:teuthology.orchestra.run.smithi007.stdout:ANSI_COLOR="0;31" 2024-03-21T16:09:53.479 INFO:teuthology.orchestra.run.smithi007.stdout:LOGO="fedora-logo-icon" 2024-03-21T16:09:53.479 INFO:teuthology.orchestra.run.smithi007.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-21T16:09:53.479 INFO:teuthology.orchestra.run.smithi007.stdout:HOME_URL="https://centos.org/" 2024-03-21T16:09:53.479 INFO:teuthology.orchestra.run.smithi007.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-21T16:09:53.479 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-21T16:09:53.479 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-21T16:09:53.480 INFO:teuthology.lock.ops:Updating smithi007.front.sepia.ceph.com on lock server 2024-03-21T16:09:53.505 INFO:teuthology.lock.ops:Updating [smithi064.front.sepia.ceph.com]: set os type and version on server 2024-03-21T16:09:53.505 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi064.front.sepia.ceph.com' 2024-03-21T16:09:53.505 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T16:09:53.605 DEBUG:teuthology.orchestra.run.smithi064:> true 2024-03-21T16:09:53.675 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi064.front.sepia.ceph.com' 2024-03-21T16:09:53.675 DEBUG:teuthology.orchestra.run.smithi064:> uname -m 2024-03-21T16:09:53.732 INFO:teuthology.orchestra.run.smithi064.stdout:x86_64 2024-03-21T16:09:53.733 DEBUG:teuthology.orchestra.run.smithi064:> cat /etc/os-release 2024-03-21T16:09:53.789 INFO:teuthology.orchestra.run.smithi064.stdout:NAME="CentOS Stream" 2024-03-21T16:09:53.789 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION="9" 2024-03-21T16:09:53.789 INFO:teuthology.orchestra.run.smithi064.stdout:ID="centos" 2024-03-21T16:09:53.789 INFO:teuthology.orchestra.run.smithi064.stdout:ID_LIKE="rhel fedora" 2024-03-21T16:09:53.789 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_ID="9" 2024-03-21T16:09:53.789 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM_ID="platform:el9" 2024-03-21T16:09:53.789 INFO:teuthology.orchestra.run.smithi064.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-21T16:09:53.789 INFO:teuthology.orchestra.run.smithi064.stdout:ANSI_COLOR="0;31" 2024-03-21T16:09:53.789 INFO:teuthology.orchestra.run.smithi064.stdout:LOGO="fedora-logo-icon" 2024-03-21T16:09:53.790 INFO:teuthology.orchestra.run.smithi064.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-21T16:09:53.790 INFO:teuthology.orchestra.run.smithi064.stdout:HOME_URL="https://centos.org/" 2024-03-21T16:09:53.790 INFO:teuthology.orchestra.run.smithi064.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-21T16:09:53.790 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-21T16:09:53.790 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-21T16:09:53.790 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server 2024-03-21T16:09:53.813 INFO:teuthology.lock.ops:Updating [smithi120.front.sepia.ceph.com]: set os type and version on server 2024-03-21T16:09:53.813 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-03-21T16:09:53.813 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-21T16:09:53.902 DEBUG:teuthology.orchestra.run.smithi120:> true 2024-03-21T16:09:54.073 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-03-21T16:09:54.073 DEBUG:teuthology.orchestra.run.smithi120:> uname -m 2024-03-21T16:09:54.128 INFO:teuthology.orchestra.run.smithi120.stdout:x86_64 2024-03-21T16:09:54.128 DEBUG:teuthology.orchestra.run.smithi120:> cat /etc/os-release 2024-03-21T16:09:54.182 INFO:teuthology.orchestra.run.smithi120.stdout:NAME="CentOS Stream" 2024-03-21T16:09:54.182 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION="9" 2024-03-21T16:09:54.183 INFO:teuthology.orchestra.run.smithi120.stdout:ID="centos" 2024-03-21T16:09:54.183 INFO:teuthology.orchestra.run.smithi120.stdout:ID_LIKE="rhel fedora" 2024-03-21T16:09:54.183 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_ID="9" 2024-03-21T16:09:54.183 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM_ID="platform:el9" 2024-03-21T16:09:54.183 INFO:teuthology.orchestra.run.smithi120.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-21T16:09:54.183 INFO:teuthology.orchestra.run.smithi120.stdout:ANSI_COLOR="0;31" 2024-03-21T16:09:54.183 INFO:teuthology.orchestra.run.smithi120.stdout:LOGO="fedora-logo-icon" 2024-03-21T16:09:54.183 INFO:teuthology.orchestra.run.smithi120.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-21T16:09:54.183 INFO:teuthology.orchestra.run.smithi120.stdout:HOME_URL="https://centos.org/" 2024-03-21T16:09:54.183 INFO:teuthology.orchestra.run.smithi120.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-21T16:09:54.183 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-21T16:09:54.184 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-21T16:09:54.184 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server 2024-03-21T16:09:54.204 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:09:54.288 INFO:teuthology.dispatcher.supervisor:Running job 7613896 2024-03-21T16:09:54.288 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-03-20_21:24:03-fs-squid-distro-default-smithi/7613896 --name teuthology-2024-03-20_21:24:03-fs-squid-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/direct_io}} -- /home/teuthworker/archive/teuthology-2024-03-20_21:24:03-fs-squid-distro-default-smithi/7613896/orig.config.yaml 2024-03-21T16:09:54.291 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-03-20_21:24:03-fs-squid-distro-default-smithi/7613896 2024-03-21T16:09:54.292 INFO:teuthology.dispatcher.supervisor:Job PID: 1848713 2024-03-21T16:09:54.292 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-21T16:11:54.393 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:13:54.573 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:15:54.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:17:54.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:19:55.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:21:55.255 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:23:55.439 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:25:55.600 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:27:55.787 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:29:55.963 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:31:56.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:33:56.316 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:35:56.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:37:56.643 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:39:56.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:41:56.983 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-21T16:41:57.048 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1