2024-03-16T08:34:24.227 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-16T08:34:24.227 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T08:34:24.408 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7faab4164c10>, signals=[15]) 2024-03-16T08:34:24.408 INFO:teuthology.lock.ops:Start node 'smithi027.front.sepia.ceph.com' reimaging 2024-03-16T08:34:24.409 INFO:teuthology.lock.ops:Updating [smithi027.front.sepia.ceph.com]: reset os type and version on server 2024-03-16T08:34:24.409 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server 2024-03-16T08:34:24.430 INFO:teuthology.lock.ops:Start node 'smithi039.front.sepia.ceph.com' reimaging 2024-03-16T08:34:24.430 INFO:teuthology.lock.ops:Updating [smithi039.front.sepia.ceph.com]: reset os type and version on server 2024-03-16T08:34:24.430 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server 2024-03-16T08:34:24.455 INFO:teuthology.lock.ops:Start node 'smithi105.front.sepia.ceph.com' reimaging 2024-03-16T08:34:24.455 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: reset os type and version on server 2024-03-16T08:34:24.455 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2024-03-16T08:34:24.552 DEBUG:teuthology.provision.fog.smithi027:Requesting image smithi_centos_9.stream (ID 10) 2024-03-16T08:34:24.583 DEBUG:teuthology.provision.fog.smithi039:Requesting image smithi_centos_9.stream (ID 10) 2024-03-16T08:34:24.593 INFO:teuthology.provision.fog.smithi027:Scheduling deploy of centos 9.stream 2024-03-16T08:34:24.597 DEBUG:teuthology.provision.fog.smithi105:Requesting image smithi_centos_9.stream (ID 10) 2024-03-16T08:34:24.622 INFO:teuthology.provision.fog.smithi039:Scheduling deploy of centos 9.stream 2024-03-16T08:34:24.653 INFO:teuthology.provision.fog.smithi105:Scheduling deploy of centos 9.stream 2024-03-16T08:34:24.841 INFO:teuthology.orchestra.console.smithi027:Power off 2024-03-16T08:34:24.842 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-16T08:34:24.855 INFO:teuthology.orchestra.console.smithi039:Power off 2024-03-16T08:34:24.856 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-16T08:34:24.864 DEBUG:teuthology.orchestra.console.smithi027:power off output: Chassis Power Control: Down/Off 2024-03-16T08:34:24.864 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T08:34:24.879 DEBUG:teuthology.orchestra.console.smithi039:power off output: Chassis Power Control: Down/Off 2024-03-16T08:34:24.879 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T08:34:24.887 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off 2024-03-16T08:34:24.901 INFO:teuthology.orchestra.console.smithi105:Power off 2024-03-16T08:34:24.901 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-16T08:34:24.909 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is off 2024-03-16T08:34:24.921 DEBUG:teuthology.orchestra.console.smithi105:power off output: Chassis Power Control: Down/Off 2024-03-16T08:34:24.921 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T08:34:24.941 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off 2024-03-16T08:34:24.988 INFO:teuthology.orchestra.console.smithi027:Power off completed 2024-03-16T08:34:25.009 INFO:teuthology.orchestra.console.smithi039:Power off completed 2024-03-16T08:34:25.043 INFO:teuthology.orchestra.console.smithi105:Power off completed 2024-03-16T08:34:25.089 INFO:teuthology.orchestra.console.smithi027:Power on 2024-03-16T08:34:25.089 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-16T08:34:25.111 INFO:teuthology.orchestra.console.smithi039:Power on 2024-03-16T08:34:25.111 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-16T08:34:25.119 DEBUG:teuthology.orchestra.console.smithi027:power on output: Chassis Power Control: Up/On 2024-03-16T08:34:25.119 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T08:34:25.143 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off 2024-03-16T08:34:25.144 DEBUG:teuthology.orchestra.console.smithi039:power on output: Chassis Power Control: Up/On 2024-03-16T08:34:25.145 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T08:34:25.151 INFO:teuthology.orchestra.console.smithi105:Power on 2024-03-16T08:34:25.151 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-16T08:34:25.168 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is off 2024-03-16T08:34:25.172 DEBUG:teuthology.orchestra.console.smithi105:power on output: Chassis Power Control: Up/On 2024-03-16T08:34:25.172 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T08:34:25.193 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off 2024-03-16T08:34:29.147 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T08:34:29.169 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T08:34:29.194 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T08:34:29.256 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on 2024-03-16T08:34:29.277 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is on 2024-03-16T08:34:29.302 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off 2024-03-16T08:34:29.357 INFO:teuthology.orchestra.console.smithi027:Power on completed 2024-03-16T08:34:29.378 INFO:teuthology.orchestra.console.smithi039:Power on completed 2024-03-16T08:34:29.458 INFO:teuthology.provision.fog.smithi027:Waiting for deploy to finish 2024-03-16T08:34:29.478 INFO:teuthology.provision.fog.smithi039:Waiting for deploy to finish 2024-03-16T08:34:33.303 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T08:34:33.450 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on 2024-03-16T08:34:33.551 INFO:teuthology.orchestra.console.smithi105:Power on completed 2024-03-16T08:34:33.652 INFO:teuthology.provision.fog.smithi105:Waiting for deploy to finish 2024-03-16T08:37:04.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T08:37:04.849 ERROR:teuthology.orchestra.connection:Error authenticating with smithi105.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-03-16T08:37:30.572 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T08:37:30.654 ERROR:teuthology.orchestra.connection:Error authenticating with smithi039.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-03-16T08:37:45.626 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T08:38:04.062 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-03-16T08:38:08.853 WARNING:teuthology.provision.fog.smithi105:timed out 2024-03-16T08:38:10.063 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T08:38:13.118 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-03-16T08:38:14.853 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T08:38:19.120 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T08:38:22.174 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-03-16T08:38:28.176 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T08:38:31.230 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-03-16T08:38:33.246 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2024-03-16T08:38:34.657 WARNING:teuthology.provision.fog.smithi039:timed out 2024-03-16T08:38:37.232 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T08:38:39.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T08:38:40.286 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-03-16T08:38:40.659 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T08:38:42.302 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2024-03-16T08:38:43.710 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39 2024-03-16T08:38:46.288 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T08:38:48.304 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T08:38:49.342 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-03-16T08:38:49.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T08:38:50.354 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-16T08:38:50.355 DEBUG:teuthology.orchestra.run.smithi105:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-16T08:38:52.766 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39 2024-03-16T08:38:55.344 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T08:38:58.398 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-03-16T08:38:58.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T08:39:04.399 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T08:39:10.699 INFO:teuthology.provision.fog.smithi105:Node is ready 2024-03-16T08:39:10.699 DEBUG:teuthology.orchestra.run.smithi105:> hostname 2024-03-16T08:39:10.717 INFO:teuthology.orchestra.run.smithi105.stdout:smithi105.front.sepia.ceph.com 2024-03-16T08:39:10.718 DEBUG:teuthology.orchestra.run.smithi105:> grep smithi105.front.sepia.ceph.com /etc/hosts 2024-03-16T08:39:10.774 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.15.105 smithi105.front.sepia.ceph.com smithi105 2024-03-16T08:39:10.775 DEBUG:teuthology.orchestra.run.smithi105:> sudo hostname smithi105 2024-03-16T08:39:10.902 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/smithi105.front.sepia.ceph.com/smithi105/g' /etc/hosts 2024-03-16T08:39:10.932 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/172.21.15.105/172.21.15.105/g' /etc/hosts 2024-03-16T08:39:11.005 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/smithi105.front.sepia.ceph.com/smithi105/g' /etc/hostname 2024-03-16T08:39:11.075 DEBUG:teuthology.orchestra.run.smithi105:> sudo hostname smithi105 2024-03-16T08:39:11.143 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release 2024-03-16T08:39:11.199 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="CentOS Stream" 2024-03-16T08:39:11.199 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="9" 2024-03-16T08:39:11.199 INFO:teuthology.orchestra.run.smithi105.stdout:ID="centos" 2024-03-16T08:39:11.199 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="rhel fedora" 2024-03-16T08:39:11.199 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="9" 2024-03-16T08:39:11.199 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el9" 2024-03-16T08:39:11.199 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-16T08:39:11.199 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31" 2024-03-16T08:39:11.199 INFO:teuthology.orchestra.run.smithi105.stdout:LOGO="fedora-logo-icon" 2024-03-16T08:39:11.199 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-16T08:39:11.199 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://centos.org/" 2024-03-16T08:39:11.200 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-16T08:39:11.200 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-16T08:39:11.200 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-16T08:39:11.200 INFO:teuthology.provision.fog.smithi105:Deploy complete! 2024-03-16T08:39:11.202 DEBUG:teuthology.parallel:result is None 2024-03-16T08:39:58.770 WARNING:teuthology.provision.fog.smithi039:timed out 2024-03-16T08:40:04.402 WARNING:teuthology.provision.fog.smithi027:timed out 2024-03-16T08:40:04.773 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T08:40:05.041 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-16T08:40:05.041 DEBUG:teuthology.orchestra.run.smithi039:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-16T08:40:05.364 INFO:teuthology.provision.fog.smithi039:Node is ready 2024-03-16T08:40:05.365 DEBUG:teuthology.orchestra.run.smithi039:> hostname 2024-03-16T08:40:05.379 INFO:teuthology.orchestra.run.smithi039.stdout:smithi039.front.sepia.ceph.com 2024-03-16T08:40:05.380 DEBUG:teuthology.orchestra.run.smithi039:> grep smithi039.front.sepia.ceph.com /etc/hosts 2024-03-16T08:40:05.434 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39 smithi039.front.sepia.ceph.com smithi039 2024-03-16T08:40:05.435 DEBUG:teuthology.orchestra.run.smithi039:> sudo hostname smithi039 2024-03-16T08:40:05.542 DEBUG:teuthology.orchestra.run.smithi039:> sudo sed -i -e 's/smithi039.front.sepia.ceph.com/smithi039/g' /etc/hosts 2024-03-16T08:40:05.573 DEBUG:teuthology.orchestra.run.smithi039:> sudo sed -i -e 's/172.21.15.39/172.21.15.39/g' /etc/hosts 2024-03-16T08:40:05.644 DEBUG:teuthology.orchestra.run.smithi039:> sudo sed -i -e 's/smithi039.front.sepia.ceph.com/smithi039/g' /etc/hostname 2024-03-16T08:40:05.714 DEBUG:teuthology.orchestra.run.smithi039:> sudo hostname smithi039 2024-03-16T08:40:05.783 DEBUG:teuthology.orchestra.run.smithi039:> cat /etc/os-release 2024-03-16T08:40:05.838 INFO:teuthology.orchestra.run.smithi039.stdout:NAME="CentOS Stream" 2024-03-16T08:40:05.838 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION="9" 2024-03-16T08:40:05.838 INFO:teuthology.orchestra.run.smithi039.stdout:ID="centos" 2024-03-16T08:40:05.838 INFO:teuthology.orchestra.run.smithi039.stdout:ID_LIKE="rhel fedora" 2024-03-16T08:40:05.838 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_ID="9" 2024-03-16T08:40:05.838 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM_ID="platform:el9" 2024-03-16T08:40:05.838 INFO:teuthology.orchestra.run.smithi039.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-16T08:40:05.838 INFO:teuthology.orchestra.run.smithi039.stdout:ANSI_COLOR="0;31" 2024-03-16T08:40:05.839 INFO:teuthology.orchestra.run.smithi039.stdout:LOGO="fedora-logo-icon" 2024-03-16T08:40:05.839 INFO:teuthology.orchestra.run.smithi039.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-16T08:40:05.839 INFO:teuthology.orchestra.run.smithi039.stdout:HOME_URL="https://centos.org/" 2024-03-16T08:40:05.839 INFO:teuthology.orchestra.run.smithi039.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-16T08:40:05.839 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-16T08:40:05.839 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-16T08:40:05.839 INFO:teuthology.provision.fog.smithi039:Deploy complete! 2024-03-16T08:40:05.839 DEBUG:teuthology.parallel:result is None 2024-03-16T08:40:10.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T08:40:10.641 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-16T08:40:10.641 DEBUG:teuthology.orchestra.run.smithi027:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-16T08:40:10.968 INFO:teuthology.provision.fog.smithi027:Node is ready 2024-03-16T08:40:10.969 DEBUG:teuthology.orchestra.run.smithi027:> hostname 2024-03-16T08:40:10.984 INFO:teuthology.orchestra.run.smithi027.stdout:smithi027.front.sepia.ceph.com 2024-03-16T08:40:10.984 DEBUG:teuthology.orchestra.run.smithi027:> grep smithi027.front.sepia.ceph.com /etc/hosts 2024-03-16T08:40:11.040 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27 smithi027.front.sepia.ceph.com smithi027 2024-03-16T08:40:11.040 DEBUG:teuthology.orchestra.run.smithi027:> sudo hostname smithi027 2024-03-16T08:40:11.157 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/smithi027.front.sepia.ceph.com/smithi027/g' /etc/hosts 2024-03-16T08:40:11.190 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/172.21.15.27/172.21.15.27/g' /etc/hosts 2024-03-16T08:40:11.262 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/smithi027.front.sepia.ceph.com/smithi027/g' /etc/hostname 2024-03-16T08:40:11.334 DEBUG:teuthology.orchestra.run.smithi027:> sudo hostname smithi027 2024-03-16T08:40:11.404 DEBUG:teuthology.orchestra.run.smithi027:> cat /etc/os-release 2024-03-16T08:40:11.459 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="CentOS Stream" 2024-03-16T08:40:11.459 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="9" 2024-03-16T08:40:11.459 INFO:teuthology.orchestra.run.smithi027.stdout:ID="centos" 2024-03-16T08:40:11.459 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE="rhel fedora" 2024-03-16T08:40:11.459 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="9" 2024-03-16T08:40:11.459 INFO:teuthology.orchestra.run.smithi027.stdout:PLATFORM_ID="platform:el9" 2024-03-16T08:40:11.459 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-16T08:40:11.459 INFO:teuthology.orchestra.run.smithi027.stdout:ANSI_COLOR="0;31" 2024-03-16T08:40:11.459 INFO:teuthology.orchestra.run.smithi027.stdout:LOGO="fedora-logo-icon" 2024-03-16T08:40:11.460 INFO:teuthology.orchestra.run.smithi027.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-16T08:40:11.460 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://centos.org/" 2024-03-16T08:40:11.460 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-16T08:40:11.460 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-16T08:40:11.460 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-16T08:40:11.460 INFO:teuthology.provision.fog.smithi027:Deploy complete! 2024-03-16T08:40:11.460 DEBUG:teuthology.parallel:result is None 2024-03-16T08:40:11.683 INFO:teuthology.lock.ops:Checking smithi027.front.sepia.ceph.com 2024-03-16T08:40:11.683 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-16T08:40:11.709 INFO:teuthology.lock.ops:Checking smithi039.front.sepia.ceph.com 2024-03-16T08:40:11.709 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-16T08:40:11.725 INFO:teuthology.lock.ops:Checking smithi105.front.sepia.ceph.com 2024-03-16T08:40:11.726 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-16T08:40:11.743 INFO:teuthology.lock.ops:Updating [smithi027.front.sepia.ceph.com]: set os type and version on server 2024-03-16T08:40:11.743 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-03-16T08:40:11.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T08:40:11.842 DEBUG:teuthology.orchestra.run.smithi027:> true 2024-03-16T08:40:11.912 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-03-16T08:40:11.912 DEBUG:teuthology.orchestra.run.smithi027:> uname -m 2024-03-16T08:40:11.966 INFO:teuthology.orchestra.run.smithi027.stdout:x86_64 2024-03-16T08:40:11.967 DEBUG:teuthology.orchestra.run.smithi027:> cat /etc/os-release 2024-03-16T08:40:12.021 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="CentOS Stream" 2024-03-16T08:40:12.021 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="9" 2024-03-16T08:40:12.021 INFO:teuthology.orchestra.run.smithi027.stdout:ID="centos" 2024-03-16T08:40:12.021 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE="rhel fedora" 2024-03-16T08:40:12.022 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="9" 2024-03-16T08:40:12.022 INFO:teuthology.orchestra.run.smithi027.stdout:PLATFORM_ID="platform:el9" 2024-03-16T08:40:12.022 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-16T08:40:12.022 INFO:teuthology.orchestra.run.smithi027.stdout:ANSI_COLOR="0;31" 2024-03-16T08:40:12.022 INFO:teuthology.orchestra.run.smithi027.stdout:LOGO="fedora-logo-icon" 2024-03-16T08:40:12.022 INFO:teuthology.orchestra.run.smithi027.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-16T08:40:12.022 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://centos.org/" 2024-03-16T08:40:12.022 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-16T08:40:12.022 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-16T08:40:12.022 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-16T08:40:12.023 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server 2024-03-16T08:40:12.059 INFO:teuthology.lock.ops:Updating [smithi039.front.sepia.ceph.com]: set os type and version on server 2024-03-16T08:40:12.059 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-03-16T08:40:12.060 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T08:40:12.162 DEBUG:teuthology.orchestra.run.smithi039:> true 2024-03-16T08:40:12.230 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-03-16T08:40:12.230 DEBUG:teuthology.orchestra.run.smithi039:> uname -m 2024-03-16T08:40:12.286 INFO:teuthology.orchestra.run.smithi039.stdout:x86_64 2024-03-16T08:40:12.286 DEBUG:teuthology.orchestra.run.smithi039:> cat /etc/os-release 2024-03-16T08:40:12.342 INFO:teuthology.orchestra.run.smithi039.stdout:NAME="CentOS Stream" 2024-03-16T08:40:12.342 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION="9" 2024-03-16T08:40:12.342 INFO:teuthology.orchestra.run.smithi039.stdout:ID="centos" 2024-03-16T08:40:12.342 INFO:teuthology.orchestra.run.smithi039.stdout:ID_LIKE="rhel fedora" 2024-03-16T08:40:12.342 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_ID="9" 2024-03-16T08:40:12.342 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM_ID="platform:el9" 2024-03-16T08:40:12.342 INFO:teuthology.orchestra.run.smithi039.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-16T08:40:12.342 INFO:teuthology.orchestra.run.smithi039.stdout:ANSI_COLOR="0;31" 2024-03-16T08:40:12.343 INFO:teuthology.orchestra.run.smithi039.stdout:LOGO="fedora-logo-icon" 2024-03-16T08:40:12.343 INFO:teuthology.orchestra.run.smithi039.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-16T08:40:12.343 INFO:teuthology.orchestra.run.smithi039.stdout:HOME_URL="https://centos.org/" 2024-03-16T08:40:12.343 INFO:teuthology.orchestra.run.smithi039.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-16T08:40:12.343 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-16T08:40:12.343 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-16T08:40:12.343 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server 2024-03-16T08:40:12.367 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: set os type and version on server 2024-03-16T08:40:12.368 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com' 2024-03-16T08:40:12.368 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T08:40:12.455 DEBUG:teuthology.orchestra.run.smithi105:> true 2024-03-16T08:40:12.624 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi105.front.sepia.ceph.com' 2024-03-16T08:40:12.624 DEBUG:teuthology.orchestra.run.smithi105:> uname -m 2024-03-16T08:40:12.679 INFO:teuthology.orchestra.run.smithi105.stdout:x86_64 2024-03-16T08:40:12.679 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release 2024-03-16T08:40:12.732 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="CentOS Stream" 2024-03-16T08:40:12.733 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="9" 2024-03-16T08:40:12.733 INFO:teuthology.orchestra.run.smithi105.stdout:ID="centos" 2024-03-16T08:40:12.733 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="rhel fedora" 2024-03-16T08:40:12.733 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="9" 2024-03-16T08:40:12.733 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el9" 2024-03-16T08:40:12.733 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-16T08:40:12.733 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31" 2024-03-16T08:40:12.733 INFO:teuthology.orchestra.run.smithi105.stdout:LOGO="fedora-logo-icon" 2024-03-16T08:40:12.733 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-16T08:40:12.733 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://centos.org/" 2024-03-16T08:40:12.733 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-16T08:40:12.733 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-16T08:40:12.733 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-16T08:40:12.734 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2024-03-16T08:40:12.759 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T08:40:12.854 INFO:teuthology.dispatcher.supervisor:Running job 7602307 2024-03-16T08:40:12.854 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-03-15_13:00:41-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7602307 --name pdonnell-2024-03-15_13:00:41-fs-wip-batrick-testing-20240314.183243-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-workunit/suites/blogbench}} -- /home/teuthworker/archive/pdonnell-2024-03-15_13:00:41-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7602307/orig.config.yaml 2024-03-16T08:40:12.857 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2024-03-15_13:00:41-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7602307 2024-03-16T08:40:12.857 INFO:teuthology.dispatcher.supervisor:Job PID: 1262685 2024-03-16T08:40:12.857 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-16T08:42:12.859 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T08:44:12.931 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T08:46:13.006 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T08:48:13.080 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T08:50:13.161 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T08:52:13.238 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T08:54:13.310 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T08:56:13.391 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T08:58:13.466 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T09:00:13.541 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T09:02:13.614 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T09:04:13.686 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T09:06:13.832 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T09:08:13.906 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T09:10:13.970 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T09:12:14.044 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T09:14:14.120 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T09:16:14.194 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T09:18:14.267 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T09:20:14.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T09:22:14.407 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T09:24:14.472 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T09:26:14.540 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T09:28:14.646 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T09:30:14.722 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T09:32:14.796 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T09:34:14.877 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T09:34:14.951 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1