2024-04-17T14:39:56.435 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-17T14:39:56.436 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T14:39:56.603 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa5171b1c10>, signals=[15]) 2024-04-17T14:39:56.604 INFO:teuthology.lock.ops:Start node 'smithi046.front.sepia.ceph.com' reimaging 2024-04-17T14:39:56.604 INFO:teuthology.lock.ops:Updating [smithi046.front.sepia.ceph.com]: reset os type and version on server 2024-04-17T14:39:56.604 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server 2024-04-17T14:39:56.621 INFO:teuthology.lock.ops:Start node 'smithi120.front.sepia.ceph.com' reimaging 2024-04-17T14:39:56.621 INFO:teuthology.lock.ops:Updating [smithi120.front.sepia.ceph.com]: reset os type and version on server 2024-04-17T14:39:56.621 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server 2024-04-17T14:39:56.637 INFO:teuthology.lock.ops:Start node 'smithi142.front.sepia.ceph.com' reimaging 2024-04-17T14:39:56.637 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: reset os type and version on server 2024-04-17T14:39:56.638 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2024-04-17T14:39:56.740 DEBUG:teuthology.provision.fog.smithi120:Requesting image smithi_centos_9.stream (ID 10) 2024-04-17T14:39:56.743 DEBUG:teuthology.provision.fog.smithi046:Requesting image smithi_centos_9.stream (ID 10) 2024-04-17T14:39:56.756 DEBUG:teuthology.provision.fog.smithi142:Requesting image smithi_centos_9.stream (ID 10) 2024-04-17T14:39:56.788 INFO:teuthology.provision.fog.smithi046:Scheduling deploy of centos 9.stream 2024-04-17T14:39:56.791 INFO:teuthology.provision.fog.smithi120:Scheduling deploy of centos 9.stream 2024-04-17T14:39:56.805 INFO:teuthology.provision.fog.smithi142:Scheduling deploy of centos 9.stream 2024-04-17T14:39:57.402 INFO:teuthology.orchestra.console.smithi120:Power off 2024-04-17T14:39:57.403 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-17T14:39:57.419 INFO:teuthology.orchestra.console.smithi046:Power off 2024-04-17T14:39:57.420 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-17T14:39:57.428 DEBUG:teuthology.orchestra.console.smithi120:power off output: Chassis Power Control: Down/Off 2024-04-17T14:39:57.428 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T14:39:57.448 DEBUG:teuthology.orchestra.console.smithi046:power off output: Chassis Power Control: Down/Off 2024-04-17T14:39:57.448 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T14:39:57.456 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is off 2024-04-17T14:39:57.469 INFO:teuthology.orchestra.console.smithi142:Power off 2024-04-17T14:39:57.469 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-17T14:39:57.477 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off 2024-04-17T14:39:57.490 DEBUG:teuthology.orchestra.console.smithi142:power off output: Chassis Power Control: Down/Off 2024-04-17T14:39:57.490 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T14:39:57.510 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off 2024-04-17T14:39:57.557 INFO:teuthology.orchestra.console.smithi120:Power off completed 2024-04-17T14:39:57.578 INFO:teuthology.orchestra.console.smithi046:Power off completed 2024-04-17T14:39:57.611 INFO:teuthology.orchestra.console.smithi142:Power off completed 2024-04-17T14:39:57.658 INFO:teuthology.orchestra.console.smithi120:Power on 2024-04-17T14:39:57.658 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-17T14:39:57.679 INFO:teuthology.orchestra.console.smithi046:Power on 2024-04-17T14:39:57.679 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-17T14:39:57.687 DEBUG:teuthology.orchestra.console.smithi120:power on output: Chassis Power Control: Up/On 2024-04-17T14:39:57.687 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T14:39:57.701 DEBUG:teuthology.orchestra.console.smithi046:power on output: Chassis Power Control: Up/On 2024-04-17T14:39:57.701 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T14:39:57.709 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is off 2024-04-17T14:39:57.711 INFO:teuthology.orchestra.console.smithi142:Power on 2024-04-17T14:39:57.711 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-17T14:39:57.723 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off 2024-04-17T14:39:57.732 DEBUG:teuthology.orchestra.console.smithi142:power on output: Chassis Power Control: Up/On 2024-04-17T14:39:57.732 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T14:39:57.754 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off 2024-04-17T14:40:01.715 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T14:40:01.725 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T14:40:01.755 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T14:40:01.823 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is on 2024-04-17T14:40:01.832 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is on 2024-04-17T14:40:01.862 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2024-04-17T14:40:01.924 INFO:teuthology.orchestra.console.smithi120:Power on completed 2024-04-17T14:40:01.933 INFO:teuthology.orchestra.console.smithi046:Power on completed 2024-04-17T14:40:01.963 INFO:teuthology.orchestra.console.smithi142:Power on completed 2024-04-17T14:40:02.026 INFO:teuthology.provision.fog.smithi120:Waiting for deploy to finish 2024-04-17T14:40:02.034 INFO:teuthology.provision.fog.smithi046:Waiting for deploy to finish 2024-04-17T14:40:02.064 INFO:teuthology.provision.fog.smithi142:Waiting for deploy to finish 2024-04-17T14:43:20.754 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:43:23.806 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-04-17T14:43:29.811 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:43:32.862 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-04-17T14:43:38.867 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:43:41.918 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-04-17T14:43:47.923 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:43:50.974 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-04-17T14:43:56.981 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:44:00.066 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-04-17T14:44:06.069 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:44:06.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:44:09.150 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-04-17T14:44:09.346 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-04-17T14:44:15.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:44:15.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:44:18.398 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-04-17T14:44:24.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:44:27.454 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-04-17T14:44:33.455 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:44:36.510 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-04-17T14:44:42.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:44:45.566 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-04-17T14:44:51.570 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:44:54.625 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-04-17T14:45:00.631 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:45:15.166 WARNING:teuthology.provision.fog.smithi120:timed out 2024-04-17T14:45:21.171 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:45:21.427 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-17T14:45:21.427 DEBUG:teuthology.orchestra.run.smithi120:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-17T14:45:21.755 INFO:teuthology.provision.fog.smithi120:Node is ready 2024-04-17T14:45:21.755 DEBUG:teuthology.orchestra.run.smithi120:> hostname 2024-04-17T14:45:21.770 INFO:teuthology.orchestra.run.smithi120.stdout:smithi120.front.sepia.ceph.com 2024-04-17T14:45:21.770 DEBUG:teuthology.orchestra.run.smithi120:> grep smithi120.front.sepia.ceph.com /etc/hosts 2024-04-17T14:45:21.825 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120 smithi120.front.sepia.ceph.com smithi120 2024-04-17T14:45:21.825 DEBUG:teuthology.orchestra.run.smithi120:> sudo hostname smithi120 2024-04-17T14:45:21.932 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i -e 's/smithi120.front.sepia.ceph.com/smithi120/g' /etc/hosts 2024-04-17T14:45:21.960 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i -e 's/172.21.15.120/172.21.15.120/g' /etc/hosts 2024-04-17T14:45:22.027 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i -e 's/smithi120.front.sepia.ceph.com/smithi120/g' /etc/hostname 2024-04-17T14:45:22.096 DEBUG:teuthology.orchestra.run.smithi120:> sudo hostname smithi120 2024-04-17T14:45:22.162 DEBUG:teuthology.orchestra.run.smithi120:> cat /etc/os-release 2024-04-17T14:45:22.219 INFO:teuthology.orchestra.run.smithi120.stdout:NAME="CentOS Stream" 2024-04-17T14:45:22.219 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION="9" 2024-04-17T14:45:22.219 INFO:teuthology.orchestra.run.smithi120.stdout:ID="centos" 2024-04-17T14:45:22.219 INFO:teuthology.orchestra.run.smithi120.stdout:ID_LIKE="rhel fedora" 2024-04-17T14:45:22.219 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_ID="9" 2024-04-17T14:45:22.219 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM_ID="platform:el9" 2024-04-17T14:45:22.219 INFO:teuthology.orchestra.run.smithi120.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T14:45:22.220 INFO:teuthology.orchestra.run.smithi120.stdout:ANSI_COLOR="0;31" 2024-04-17T14:45:22.220 INFO:teuthology.orchestra.run.smithi120.stdout:LOGO="fedora-logo-icon" 2024-04-17T14:45:22.220 INFO:teuthology.orchestra.run.smithi120.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T14:45:22.220 INFO:teuthology.orchestra.run.smithi120.stdout:HOME_URL="https://centos.org/" 2024-04-17T14:45:22.220 INFO:teuthology.orchestra.run.smithi120.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T14:45:22.220 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T14:45:22.220 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T14:45:22.220 INFO:teuthology.provision.fog.smithi120:Deploy complete! 2024-04-17T14:45:22.222 DEBUG:teuthology.parallel:result is None 2024-04-17T14:46:00.638 WARNING:teuthology.provision.fog.smithi046:timed out 2024-04-17T14:46:06.643 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:46:06.892 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-17T14:46:06.892 DEBUG:teuthology.orchestra.run.smithi046:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-17T14:46:07.251 INFO:teuthology.provision.fog.smithi046:Node is ready 2024-04-17T14:46:07.252 DEBUG:teuthology.orchestra.run.smithi046:> hostname 2024-04-17T14:46:07.266 INFO:teuthology.orchestra.run.smithi046.stdout:smithi046.front.sepia.ceph.com 2024-04-17T14:46:07.266 DEBUG:teuthology.orchestra.run.smithi046:> grep smithi046.front.sepia.ceph.com /etc/hosts 2024-04-17T14:46:07.322 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2024-04-17T14:46:07.322 DEBUG:teuthology.orchestra.run.smithi046:> sudo hostname smithi046 2024-04-17T14:46:07.438 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i -e 's/smithi046.front.sepia.ceph.com/smithi046/g' /etc/hosts 2024-04-17T14:46:07.470 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i -e 's/172.21.15.46/172.21.15.46/g' /etc/hosts 2024-04-17T14:46:07.540 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i -e 's/smithi046.front.sepia.ceph.com/smithi046/g' /etc/hostname 2024-04-17T14:46:07.611 DEBUG:teuthology.orchestra.run.smithi046:> sudo hostname smithi046 2024-04-17T14:46:07.681 DEBUG:teuthology.orchestra.run.smithi046:> cat /etc/os-release 2024-04-17T14:46:07.736 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="CentOS Stream" 2024-04-17T14:46:07.736 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="9" 2024-04-17T14:46:07.736 INFO:teuthology.orchestra.run.smithi046.stdout:ID="centos" 2024-04-17T14:46:07.737 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE="rhel fedora" 2024-04-17T14:46:07.737 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="9" 2024-04-17T14:46:07.737 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM_ID="platform:el9" 2024-04-17T14:46:07.737 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T14:46:07.737 INFO:teuthology.orchestra.run.smithi046.stdout:ANSI_COLOR="0;31" 2024-04-17T14:46:07.737 INFO:teuthology.orchestra.run.smithi046.stdout:LOGO="fedora-logo-icon" 2024-04-17T14:46:07.737 INFO:teuthology.orchestra.run.smithi046.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T14:46:07.737 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://centos.org/" 2024-04-17T14:46:07.737 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T14:46:07.737 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T14:46:07.737 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T14:46:07.737 INFO:teuthology.provision.fog.smithi046:Deploy complete! 2024-04-17T14:46:07.738 DEBUG:teuthology.parallel:result is None 2024-04-17T14:46:52.996 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:46:56.062 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-04-17T14:47:02.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:47:05.150 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-04-17T14:47:11.157 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:47:14.238 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-04-17T14:47:20.245 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:47:23.326 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-04-17T14:47:29.334 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:47:32.414 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-04-17T14:47:38.420 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:47:41.470 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-04-17T14:47:47.475 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:48:47.537 WARNING:teuthology.provision.fog.smithi142:timed out 2024-04-17T14:48:53.543 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:48:53.796 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-17T14:48:53.796 DEBUG:teuthology.orchestra.run.smithi142:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-17T14:48:54.105 INFO:teuthology.provision.fog.smithi142:Node is ready 2024-04-17T14:48:54.105 DEBUG:teuthology.orchestra.run.smithi142:> hostname 2024-04-17T14:48:54.120 INFO:teuthology.orchestra.run.smithi142.stdout:smithi142.front.sepia.ceph.com 2024-04-17T14:48:54.120 DEBUG:teuthology.orchestra.run.smithi142:> grep smithi142.front.sepia.ceph.com /etc/hosts 2024-04-17T14:48:54.175 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142 smithi142.front.sepia.ceph.com smithi142 2024-04-17T14:48:54.175 DEBUG:teuthology.orchestra.run.smithi142:> sudo hostname smithi142 2024-04-17T14:48:54.275 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/smithi142.front.sepia.ceph.com/smithi142/g' /etc/hosts 2024-04-17T14:48:54.302 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/172.21.15.142/172.21.15.142/g' /etc/hosts 2024-04-17T14:48:54.369 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/smithi142.front.sepia.ceph.com/smithi142/g' /etc/hostname 2024-04-17T14:48:54.436 DEBUG:teuthology.orchestra.run.smithi142:> sudo hostname smithi142 2024-04-17T14:48:54.503 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2024-04-17T14:48:54.557 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="CentOS Stream" 2024-04-17T14:48:54.557 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="9" 2024-04-17T14:48:54.557 INFO:teuthology.orchestra.run.smithi142.stdout:ID="centos" 2024-04-17T14:48:54.557 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="rhel fedora" 2024-04-17T14:48:54.557 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="9" 2024-04-17T14:48:54.557 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el9" 2024-04-17T14:48:54.557 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T14:48:54.557 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31" 2024-04-17T14:48:54.557 INFO:teuthology.orchestra.run.smithi142.stdout:LOGO="fedora-logo-icon" 2024-04-17T14:48:54.557 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T14:48:54.558 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://centos.org/" 2024-04-17T14:48:54.558 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T14:48:54.558 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T14:48:54.558 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T14:48:54.558 INFO:teuthology.provision.fog.smithi142:Deploy complete! 2024-04-17T14:48:54.559 DEBUG:teuthology.parallel:result is None 2024-04-17T14:48:54.775 INFO:teuthology.lock.ops:Checking smithi046.front.sepia.ceph.com 2024-04-17T14:48:54.776 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-17T14:48:54.796 INFO:teuthology.lock.ops:Checking smithi120.front.sepia.ceph.com 2024-04-17T14:48:54.797 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-17T14:48:54.813 INFO:teuthology.lock.ops:Checking smithi142.front.sepia.ceph.com 2024-04-17T14:48:54.813 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-17T14:48:54.831 INFO:teuthology.lock.ops:Updating [smithi046.front.sepia.ceph.com]: set os type and version on server 2024-04-17T14:48:54.831 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-04-17T14:48:54.831 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:48:54.936 DEBUG:teuthology.orchestra.run.smithi046:> true 2024-04-17T14:48:55.125 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-04-17T14:48:55.125 DEBUG:teuthology.orchestra.run.smithi046:> uname -m 2024-04-17T14:48:55.179 INFO:teuthology.orchestra.run.smithi046.stdout:x86_64 2024-04-17T14:48:55.179 DEBUG:teuthology.orchestra.run.smithi046:> cat /etc/os-release 2024-04-17T14:48:55.234 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="CentOS Stream" 2024-04-17T14:48:55.234 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="9" 2024-04-17T14:48:55.234 INFO:teuthology.orchestra.run.smithi046.stdout:ID="centos" 2024-04-17T14:48:55.234 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE="rhel fedora" 2024-04-17T14:48:55.234 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="9" 2024-04-17T14:48:55.234 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM_ID="platform:el9" 2024-04-17T14:48:55.234 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T14:48:55.235 INFO:teuthology.orchestra.run.smithi046.stdout:ANSI_COLOR="0;31" 2024-04-17T14:48:55.235 INFO:teuthology.orchestra.run.smithi046.stdout:LOGO="fedora-logo-icon" 2024-04-17T14:48:55.235 INFO:teuthology.orchestra.run.smithi046.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T14:48:55.235 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://centos.org/" 2024-04-17T14:48:55.235 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T14:48:55.235 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T14:48:55.235 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T14:48:55.235 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server 2024-04-17T14:48:55.255 INFO:teuthology.lock.ops:Updating [smithi120.front.sepia.ceph.com]: set os type and version on server 2024-04-17T14:48:55.255 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-04-17T14:48:55.256 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:48:55.343 DEBUG:teuthology.orchestra.run.smithi120:> true 2024-04-17T14:48:55.512 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-04-17T14:48:55.512 DEBUG:teuthology.orchestra.run.smithi120:> uname -m 2024-04-17T14:48:55.566 INFO:teuthology.orchestra.run.smithi120.stdout:x86_64 2024-04-17T14:48:55.566 DEBUG:teuthology.orchestra.run.smithi120:> cat /etc/os-release 2024-04-17T14:48:55.620 INFO:teuthology.orchestra.run.smithi120.stdout:NAME="CentOS Stream" 2024-04-17T14:48:55.620 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION="9" 2024-04-17T14:48:55.620 INFO:teuthology.orchestra.run.smithi120.stdout:ID="centos" 2024-04-17T14:48:55.621 INFO:teuthology.orchestra.run.smithi120.stdout:ID_LIKE="rhel fedora" 2024-04-17T14:48:55.621 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_ID="9" 2024-04-17T14:48:55.621 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM_ID="platform:el9" 2024-04-17T14:48:55.621 INFO:teuthology.orchestra.run.smithi120.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T14:48:55.621 INFO:teuthology.orchestra.run.smithi120.stdout:ANSI_COLOR="0;31" 2024-04-17T14:48:55.621 INFO:teuthology.orchestra.run.smithi120.stdout:LOGO="fedora-logo-icon" 2024-04-17T14:48:55.621 INFO:teuthology.orchestra.run.smithi120.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T14:48:55.621 INFO:teuthology.orchestra.run.smithi120.stdout:HOME_URL="https://centos.org/" 2024-04-17T14:48:55.621 INFO:teuthology.orchestra.run.smithi120.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T14:48:55.621 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T14:48:55.621 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T14:48:55.622 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server 2024-04-17T14:48:55.647 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: set os type and version on server 2024-04-17T14:48:55.647 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-04-17T14:48:55.647 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T14:48:55.733 DEBUG:teuthology.orchestra.run.smithi142:> true 2024-04-17T14:48:55.801 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-04-17T14:48:55.801 DEBUG:teuthology.orchestra.run.smithi142:> uname -m 2024-04-17T14:48:55.856 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64 2024-04-17T14:48:55.856 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2024-04-17T14:48:55.911 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="CentOS Stream" 2024-04-17T14:48:55.911 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="9" 2024-04-17T14:48:55.911 INFO:teuthology.orchestra.run.smithi142.stdout:ID="centos" 2024-04-17T14:48:55.911 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="rhel fedora" 2024-04-17T14:48:55.911 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="9" 2024-04-17T14:48:55.911 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el9" 2024-04-17T14:48:55.911 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T14:48:55.911 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31" 2024-04-17T14:48:55.911 INFO:teuthology.orchestra.run.smithi142.stdout:LOGO="fedora-logo-icon" 2024-04-17T14:48:55.911 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T14:48:55.911 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://centos.org/" 2024-04-17T14:48:55.911 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T14:48:55.911 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T14:48:55.911 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T14:48:55.912 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2024-04-17T14:48:55.947 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T14:48:56.038 INFO:teuthology.dispatcher.supervisor:Running job 7660385 2024-04-17T14:48:56.038 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2024-04-17_11:26:41-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660385 --name rishabh-2024-04-17_11:26:41-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-workunit/suites/ffsb}} -- /home/teuthworker/archive/rishabh-2024-04-17_11:26:41-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660385/orig.config.yaml 2024-04-17T14:48:56.040 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2024-04-17_11:26:41-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660385 2024-04-17T14:48:56.041 INFO:teuthology.dispatcher.supervisor:Job PID: 1517804 2024-04-17T14:48:56.041 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-17T14:50:56.136 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T14:52:56.312 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T14:54:56.475 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T14:56:56.637 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T14:58:56.811 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T15:00:56.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T15:02:57.159 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T15:04:57.333 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T15:04:57.399 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1