2024-04-18T03:22:45.264 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-18T03:22:45.265 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T03:22:45.422 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd7471f9c10>, signals=[15]) 2024-04-18T03:22:45.422 INFO:teuthology.lock.ops:Start node 'smithi153.front.sepia.ceph.com' reimaging 2024-04-18T03:22:45.422 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: reset os type and version on server 2024-04-18T03:22:45.422 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2024-04-18T03:22:45.443 INFO:teuthology.lock.ops:Start node 'smithi172.front.sepia.ceph.com' reimaging 2024-04-18T03:22:45.443 INFO:teuthology.lock.ops:Updating [smithi172.front.sepia.ceph.com]: reset os type and version on server 2024-04-18T03:22:45.443 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2024-04-18T03:22:45.567 DEBUG:teuthology.provision.fog.smithi153:Requesting image smithi_rhel_8.6 (ID 5) 2024-04-18T03:22:45.584 DEBUG:teuthology.provision.fog.smithi172:Requesting image smithi_rhel_8.6 (ID 5) 2024-04-18T03:22:45.609 INFO:teuthology.provision.fog.smithi153:Scheduling deploy of rhel 8.6 2024-04-18T03:22:45.634 INFO:teuthology.provision.fog.smithi172:Scheduling deploy of rhel 8.6 2024-04-18T03:22:45.869 INFO:teuthology.orchestra.console.smithi153:Power off 2024-04-18T03:22:45.869 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-18T03:22:45.883 INFO:teuthology.orchestra.console.smithi172:Power off 2024-04-18T03:22:45.883 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-18T03:22:45.892 DEBUG:teuthology.orchestra.console.smithi153:power off output: Chassis Power Control: Down/Off 2024-04-18T03:22:45.892 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T03:22:45.906 DEBUG:teuthology.orchestra.console.smithi172:power off output: Chassis Power Control: Down/Off 2024-04-18T03:22:45.906 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T03:22:45.916 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2024-04-18T03:22:45.928 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2024-04-18T03:22:49.918 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T03:22:49.929 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T03:22:50.028 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2024-04-18T03:22:50.038 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2024-04-18T03:22:54.034 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T03:22:54.042 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T03:22:54.144 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off 2024-04-18T03:22:54.151 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2024-04-18T03:22:54.245 INFO:teuthology.orchestra.console.smithi153:Power off completed 2024-04-18T03:22:54.346 INFO:teuthology.orchestra.console.smithi153:Power on 2024-04-18T03:22:54.346 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-18T03:22:54.367 DEBUG:teuthology.orchestra.console.smithi153:power on output: Chassis Power Control: Up/On 2024-04-18T03:22:54.367 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T03:22:54.387 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off 2024-04-18T03:22:58.154 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T03:22:58.264 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off 2024-04-18T03:22:58.365 INFO:teuthology.orchestra.console.smithi172:Power off completed 2024-04-18T03:22:58.388 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T03:22:58.466 INFO:teuthology.orchestra.console.smithi172:Power on 2024-04-18T03:22:58.466 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-18T03:22:58.489 DEBUG:teuthology.orchestra.console.smithi172:power on output: Chassis Power Control: Up/On 2024-04-18T03:22:58.490 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T03:22:58.499 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off 2024-04-18T03:22:58.513 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off 2024-04-18T03:23:02.502 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T03:23:02.515 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T03:23:02.612 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2024-04-18T03:23:02.625 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off 2024-04-18T03:23:02.714 INFO:teuthology.orchestra.console.smithi153:Power on completed 2024-04-18T03:23:02.817 INFO:teuthology.provision.fog.smithi153:Waiting for deploy to finish 2024-04-18T03:23:06.628 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T03:23:06.738 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2024-04-18T03:23:06.838 INFO:teuthology.orchestra.console.smithi172:Power on completed 2024-04-18T03:23:06.939 INFO:teuthology.provision.fog.smithi172:Waiting for deploy to finish 2024-04-18T03:25:48.633 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T03:25:52.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T03:25:52.787 ERROR:teuthology.orchestra.connection:Error authenticating with smithi172.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-04-18T03:26:07.138 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-04-18T03:26:07.139 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2024-04-18T03:26:13.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T03:26:13.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T03:26:16.194 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-04-18T03:26:16.226 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2024-04-18T03:26:22.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T03:26:22.227 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T03:26:25.282 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-04-18T03:26:25.283 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2024-04-18T03:26:31.284 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T03:26:31.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T03:26:34.338 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-04-18T03:26:34.370 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2024-04-18T03:26:40.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T03:26:40.371 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T03:26:43.390 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-04-18T03:26:43.422 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2024-04-18T03:26:49.391 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T03:26:49.423 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T03:26:52.446 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-04-18T03:26:58.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T03:27:01.506 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-04-18T03:27:07.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T03:27:07.810 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2024-04-18T03:27:13.812 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T03:27:16.866 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2024-04-18T03:27:22.867 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T03:27:25.918 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2024-04-18T03:27:31.920 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T03:27:32.668 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-18T03:27:32.669 DEBUG:teuthology.orchestra.run.smithi153:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-18T03:27:48.491 INFO:teuthology.provision.fog.smithi153:Node is ready 2024-04-18T03:27:48.492 DEBUG:teuthology.orchestra.run.smithi153:> hostname 2024-04-18T03:27:48.513 INFO:teuthology.orchestra.run.smithi153.stdout:smithi153.front.sepia.ceph.com 2024-04-18T03:27:48.514 DEBUG:teuthology.orchestra.run.smithi153:> grep smithi153.front.sepia.ceph.com /etc/hosts 2024-04-18T03:27:48.574 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.15.153 smithi153.front.sepia.ceph.com smithi153 2024-04-18T03:27:48.575 DEBUG:teuthology.orchestra.run.smithi153:> sudo hostname smithi153 2024-04-18T03:27:48.712 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/smithi153.front.sepia.ceph.com/smithi153/g' /etc/hosts 2024-04-18T03:27:48.744 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/172.21.15.153/172.21.15.153/g' /etc/hosts 2024-04-18T03:27:48.813 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/smithi153.front.sepia.ceph.com/smithi153/g' /etc/hostname 2024-04-18T03:27:48.881 DEBUG:teuthology.orchestra.run.smithi153:> sudo hostname smithi153 2024-04-18T03:27:48.950 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release 2024-04-18T03:27:49.007 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="Red Hat Enterprise Linux" 2024-04-18T03:27:49.007 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="8.6 (Ootpa)" 2024-04-18T03:27:49.007 INFO:teuthology.orchestra.run.smithi153.stdout:ID="rhel" 2024-04-18T03:27:49.007 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE="fedora" 2024-04-18T03:27:49.007 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="8.6" 2024-04-18T03:27:49.007 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM_ID="platform:el8" 2024-04-18T03:27:49.007 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-04-18T03:27:49.007 INFO:teuthology.orchestra.run.smithi153.stdout:ANSI_COLOR="0;31" 2024-04-18T03:27:49.007 INFO:teuthology.orchestra.run.smithi153.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-04-18T03:27:49.008 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://www.redhat.com/" 2024-04-18T03:27:49.008 INFO:teuthology.orchestra.run.smithi153.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-04-18T03:27:49.008 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T03:27:49.008 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-04-18T03:27:49.008 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-18T03:27:49.008 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-04-18T03:27:49.008 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-04-18T03:27:49.008 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-04-18T03:27:49.010 INFO:teuthology.provision.fog.smithi153:Deploy complete! 2024-04-18T03:27:49.011 DEBUG:teuthology.parallel:result is None 2024-04-18T03:28:07.510 WARNING:teuthology.provision.fog.smithi172:timed out 2024-04-18T03:28:13.512 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T03:28:13.739 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-18T03:28:13.740 DEBUG:teuthology.orchestra.run.smithi172:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-18T03:28:14.017 INFO:teuthology.provision.fog.smithi172:Node is ready 2024-04-18T03:28:14.018 DEBUG:teuthology.orchestra.run.smithi172:> hostname 2024-04-18T03:28:14.035 INFO:teuthology.orchestra.run.smithi172.stdout:smithi172.front.sepia.ceph.com 2024-04-18T03:28:14.036 DEBUG:teuthology.orchestra.run.smithi172:> grep smithi172.front.sepia.ceph.com /etc/hosts 2024-04-18T03:28:14.093 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.15.172 smithi172.front.sepia.ceph.com smithi172 2024-04-18T03:28:14.094 DEBUG:teuthology.orchestra.run.smithi172:> sudo hostname smithi172 2024-04-18T03:28:14.214 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/smithi172.front.sepia.ceph.com/smithi172/g' /etc/hosts 2024-04-18T03:28:14.243 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/172.21.15.172/172.21.15.172/g' /etc/hosts 2024-04-18T03:28:14.311 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/smithi172.front.sepia.ceph.com/smithi172/g' /etc/hostname 2024-04-18T03:28:14.378 DEBUG:teuthology.orchestra.run.smithi172:> sudo hostname smithi172 2024-04-18T03:28:14.444 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2024-04-18T03:28:14.501 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="Red Hat Enterprise Linux" 2024-04-18T03:28:14.501 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="8.6 (Ootpa)" 2024-04-18T03:28:14.501 INFO:teuthology.orchestra.run.smithi172.stdout:ID="rhel" 2024-04-18T03:28:14.501 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="fedora" 2024-04-18T03:28:14.501 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="8.6" 2024-04-18T03:28:14.501 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el8" 2024-04-18T03:28:14.501 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-04-18T03:28:14.501 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2024-04-18T03:28:14.501 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-04-18T03:28:14.501 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://www.redhat.com/" 2024-04-18T03:28:14.501 INFO:teuthology.orchestra.run.smithi172.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-04-18T03:28:14.501 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T03:28:14.502 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-18T03:28:14.502 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-18T03:28:14.502 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-04-18T03:28:14.502 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-04-18T03:28:14.502 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-04-18T03:28:14.502 INFO:teuthology.provision.fog.smithi172:Deploy complete! 2024-04-18T03:28:14.503 DEBUG:teuthology.parallel:result is None 2024-04-18T03:28:14.669 INFO:teuthology.lock.ops:Checking smithi153.front.sepia.ceph.com 2024-04-18T03:28:14.669 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-18T03:28:14.817 INFO:teuthology.lock.ops:Checking smithi172.front.sepia.ceph.com 2024-04-18T03:28:14.817 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-18T03:28:14.928 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: set os type and version on server 2024-04-18T03:28:14.929 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-04-18T03:28:14.929 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T03:28:15.004 DEBUG:teuthology.orchestra.run.smithi153:> true 2024-04-18T03:28:15.140 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-04-18T03:28:15.140 DEBUG:teuthology.orchestra.run.smithi153:> uname -m 2024-04-18T03:28:15.198 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64 2024-04-18T03:28:15.199 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release 2024-04-18T03:28:15.256 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="Red Hat Enterprise Linux" 2024-04-18T03:28:15.256 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="8.6 (Ootpa)" 2024-04-18T03:28:15.256 INFO:teuthology.orchestra.run.smithi153.stdout:ID="rhel" 2024-04-18T03:28:15.256 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE="fedora" 2024-04-18T03:28:15.256 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="8.6" 2024-04-18T03:28:15.256 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM_ID="platform:el8" 2024-04-18T03:28:15.256 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-04-18T03:28:15.256 INFO:teuthology.orchestra.run.smithi153.stdout:ANSI_COLOR="0;31" 2024-04-18T03:28:15.257 INFO:teuthology.orchestra.run.smithi153.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-04-18T03:28:15.257 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://www.redhat.com/" 2024-04-18T03:28:15.257 INFO:teuthology.orchestra.run.smithi153.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-04-18T03:28:15.257 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T03:28:15.257 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-04-18T03:28:15.257 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-18T03:28:15.257 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-04-18T03:28:15.257 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-04-18T03:28:15.257 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-04-18T03:28:15.257 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2024-04-18T03:28:15.286 INFO:teuthology.lock.ops:Updating [smithi172.front.sepia.ceph.com]: set os type and version on server 2024-04-18T03:28:15.286 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-04-18T03:28:15.287 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T03:28:15.359 DEBUG:teuthology.orchestra.run.smithi172:> true 2024-04-18T03:28:15.432 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-04-18T03:28:15.432 DEBUG:teuthology.orchestra.run.smithi172:> uname -m 2024-04-18T03:28:15.489 INFO:teuthology.orchestra.run.smithi172.stdout:x86_64 2024-04-18T03:28:15.490 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2024-04-18T03:28:15.547 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="Red Hat Enterprise Linux" 2024-04-18T03:28:15.547 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="8.6 (Ootpa)" 2024-04-18T03:28:15.547 INFO:teuthology.orchestra.run.smithi172.stdout:ID="rhel" 2024-04-18T03:28:15.547 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="fedora" 2024-04-18T03:28:15.547 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="8.6" 2024-04-18T03:28:15.547 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el8" 2024-04-18T03:28:15.548 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-04-18T03:28:15.548 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2024-04-18T03:28:15.548 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-04-18T03:28:15.548 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://www.redhat.com/" 2024-04-18T03:28:15.548 INFO:teuthology.orchestra.run.smithi172.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-04-18T03:28:15.548 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T03:28:15.548 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-04-18T03:28:15.548 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-18T03:28:15.548 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-04-18T03:28:15.548 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-04-18T03:28:15.548 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-04-18T03:28:15.549 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2024-04-18T03:28:15.571 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T03:28:15.671 INFO:teuthology.dispatcher.supervisor:Running job 7661444 2024-04-18T03:28:15.671 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661444 --name teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi --description fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_fsstress}} -- /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661444/orig.config.yaml 2024-04-18T03:28:15.674 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661444 2024-04-18T03:28:15.674 INFO:teuthology.dispatcher.supervisor:Job PID: 922331 2024-04-18T03:28:15.674 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-18T03:30:15.676 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T03:32:15.749 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T03:34:15.822 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T03:36:15.894 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T03:38:15.957 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T03:40:16.033 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T03:40:16.102 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1