2024-01-21T12:07:58.999 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-21T12:07:59.000 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T12:07:59.138 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4a8f9cdc10>, signals=[15]) 2024-01-21T12:07:59.138 INFO:teuthology.lock.ops:Start node 'smithi138.front.sepia.ceph.com' reimaging 2024-01-21T12:07:59.139 INFO:teuthology.lock.ops:Updating [smithi138.front.sepia.ceph.com]: reset os type and version on server 2024-01-21T12:07:59.139 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server 2024-01-21T12:07:59.162 INFO:teuthology.lock.ops:Start node 'smithi175.front.sepia.ceph.com' reimaging 2024-01-21T12:07:59.162 INFO:teuthology.lock.ops:Updating [smithi175.front.sepia.ceph.com]: reset os type and version on server 2024-01-21T12:07:59.162 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server 2024-01-21T12:07:59.263 DEBUG:teuthology.provision.fog.smithi138:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-21T12:07:59.292 DEBUG:teuthology.provision.fog.smithi175:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-21T12:07:59.322 INFO:teuthology.provision.fog.smithi138:Scheduling deploy of rhel 8.6 2024-01-21T12:07:59.342 INFO:teuthology.provision.fog.smithi175:Scheduling deploy of rhel 8.6 2024-01-21T12:07:59.691 INFO:teuthology.orchestra.console.smithi175:Power off 2024-01-21T12:07:59.691 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-21T12:07:59.703 INFO:teuthology.orchestra.console.smithi138:Power off 2024-01-21T12:07:59.703 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-21T12:07:59.711 DEBUG:teuthology.orchestra.console.smithi175:power off output: Chassis Power Control: Down/Off 2024-01-21T12:07:59.711 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-21T12:07:59.723 DEBUG:teuthology.orchestra.console.smithi138:power off output: Chassis Power Control: Down/Off 2024-01-21T12:07:59.723 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-21T12:07:59.730 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2024-01-21T12:07:59.745 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off 2024-01-21T12:07:59.831 INFO:teuthology.orchestra.console.smithi175:Power off completed 2024-01-21T12:07:59.846 INFO:teuthology.orchestra.console.smithi138:Power off completed 2024-01-21T12:07:59.932 INFO:teuthology.orchestra.console.smithi175:Power on 2024-01-21T12:07:59.932 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-21T12:07:59.947 INFO:teuthology.orchestra.console.smithi138:Power on 2024-01-21T12:07:59.947 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-21T12:07:59.955 DEBUG:teuthology.orchestra.console.smithi175:power on output: Chassis Power Control: Up/On 2024-01-21T12:07:59.955 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-21T12:07:59.969 DEBUG:teuthology.orchestra.console.smithi138:power on output: Chassis Power Control: Up/On 2024-01-21T12:07:59.969 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-21T12:07:59.976 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2024-01-21T12:07:59.990 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off 2024-01-21T12:08:03.981 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-21T12:08:03.991 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-21T12:08:04.090 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2024-01-21T12:08:04.099 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is on 2024-01-21T12:08:04.199 INFO:teuthology.orchestra.console.smithi138:Power on completed 2024-01-21T12:08:04.300 INFO:teuthology.provision.fog.smithi138:Waiting for deploy to finish 2024-01-21T12:08:08.095 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-21T12:08:08.204 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on 2024-01-21T12:08:08.304 INFO:teuthology.orchestra.console.smithi175:Power on completed 2024-01-21T12:08:08.405 INFO:teuthology.provision.fog.smithi175:Waiting for deploy to finish 2024-01-21T12:10:55.091 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T12:10:55.093 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T12:11:13.596 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2024-01-21T12:11:13.597 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2024-01-21T12:11:19.601 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T12:11:19.603 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T12:11:22.652 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2024-01-21T12:11:22.684 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2024-01-21T12:11:28.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T12:11:28.685 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T12:11:31.740 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2024-01-21T12:11:31.740 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2024-01-21T12:11:37.747 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T12:11:37.749 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T12:11:40.828 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2024-01-21T12:11:46.835 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T12:11:49.916 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2024-01-21T12:11:55.923 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T12:12:37.791 WARNING:teuthology.provision.fog.smithi138:timed out 2024-01-21T12:12:43.795 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T12:12:44.025 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-21T12:12:44.025 DEBUG:teuthology.orchestra.run.smithi138:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-21T12:12:44.320 INFO:teuthology.provision.fog.smithi138:Node is ready 2024-01-21T12:12:44.320 DEBUG:teuthology.orchestra.run.smithi138:> hostname 2024-01-21T12:12:44.339 INFO:teuthology.orchestra.run.smithi138.stdout:smithi138.front.sepia.ceph.com 2024-01-21T12:12:44.339 DEBUG:teuthology.orchestra.run.smithi138:> grep smithi138.front.sepia.ceph.com /etc/hosts 2024-01-21T12:12:44.398 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138 smithi138.front.sepia.ceph.com smithi138 2024-01-21T12:12:44.399 DEBUG:teuthology.orchestra.run.smithi138:> sudo hostname smithi138 2024-01-21T12:12:44.512 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/smithi138.front.sepia.ceph.com/smithi138/g' /etc/hosts 2024-01-21T12:12:44.542 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/172.21.15.138/172.21.15.138/g' /etc/hosts 2024-01-21T12:12:44.611 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/smithi138.front.sepia.ceph.com/smithi138/g' /etc/hostname 2024-01-21T12:12:44.682 DEBUG:teuthology.orchestra.run.smithi138:> sudo hostname smithi138 2024-01-21T12:12:44.749 DEBUG:teuthology.orchestra.run.smithi138:> cat /etc/os-release 2024-01-21T12:12:44.806 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="Red Hat Enterprise Linux" 2024-01-21T12:12:44.806 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="8.6 (Ootpa)" 2024-01-21T12:12:44.806 INFO:teuthology.orchestra.run.smithi138.stdout:ID="rhel" 2024-01-21T12:12:44.807 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE="fedora" 2024-01-21T12:12:44.807 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="8.6" 2024-01-21T12:12:44.807 INFO:teuthology.orchestra.run.smithi138.stdout:PLATFORM_ID="platform:el8" 2024-01-21T12:12:44.807 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-21T12:12:44.807 INFO:teuthology.orchestra.run.smithi138.stdout:ANSI_COLOR="0;31" 2024-01-21T12:12:44.807 INFO:teuthology.orchestra.run.smithi138.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-21T12:12:44.807 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://www.redhat.com/" 2024-01-21T12:12:44.807 INFO:teuthology.orchestra.run.smithi138.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-21T12:12:44.808 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-21T12:12:44.808 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-01-21T12:12:44.808 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-21T12:12:44.808 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-21T12:12:44.808 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-21T12:12:44.808 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-21T12:12:44.809 INFO:teuthology.provision.fog.smithi138:Deploy complete! 2024-01-21T12:12:44.811 DEBUG:teuthology.parallel:result is None 2024-01-21T12:12:55.937 WARNING:teuthology.provision.fog.smithi175:timed out 2024-01-21T12:13:01.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T12:13:02.176 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-21T12:13:02.176 DEBUG:teuthology.orchestra.run.smithi175:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-21T12:13:02.448 INFO:teuthology.provision.fog.smithi175:Node is ready 2024-01-21T12:13:02.448 DEBUG:teuthology.orchestra.run.smithi175:> hostname 2024-01-21T12:13:02.466 INFO:teuthology.orchestra.run.smithi175.stdout:smithi175 2024-01-21T12:13:02.466 DEBUG:teuthology.orchestra.run.smithi175:> grep smithi175 /etc/hosts 2024-01-21T12:13:02.523 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.15.175 smithi175.front.sepia.ceph.com smithi175 2024-01-21T12:13:02.523 DEBUG:teuthology.orchestra.run.smithi175:> sudo hostname smithi175 2024-01-21T12:13:02.646 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/smithi175/smithi175/g' /etc/hosts 2024-01-21T12:13:02.674 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/172.21.15.175/172.21.15.175/g' /etc/hosts 2024-01-21T12:13:02.742 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/smithi175/smithi175/g' /etc/hostname 2024-01-21T12:13:02.810 DEBUG:teuthology.orchestra.run.smithi175:> sudo hostname smithi175 2024-01-21T12:13:02.879 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release 2024-01-21T12:13:02.939 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="Red Hat Enterprise Linux" 2024-01-21T12:13:02.939 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="8.6 (Ootpa)" 2024-01-21T12:13:02.939 INFO:teuthology.orchestra.run.smithi175.stdout:ID="rhel" 2024-01-21T12:13:02.939 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="fedora" 2024-01-21T12:13:02.939 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="8.6" 2024-01-21T12:13:02.939 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el8" 2024-01-21T12:13:02.939 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-21T12:13:02.939 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31" 2024-01-21T12:13:02.940 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-21T12:13:02.940 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://www.redhat.com/" 2024-01-21T12:13:02.940 INFO:teuthology.orchestra.run.smithi175.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-21T12:13:02.940 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-21T12:13:02.940 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-01-21T12:13:02.940 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-21T12:13:02.940 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-21T12:13:02.940 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-21T12:13:02.940 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-21T12:13:02.940 INFO:teuthology.provision.fog.smithi175:Deploy complete! 2024-01-21T12:13:02.941 DEBUG:teuthology.parallel:result is None 2024-01-21T12:13:03.108 INFO:teuthology.lock.ops:Checking smithi138.front.sepia.ceph.com 2024-01-21T12:13:03.109 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-21T12:13:03.127 INFO:teuthology.lock.ops:Checking smithi175.front.sepia.ceph.com 2024-01-21T12:13:03.127 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-21T12:13:03.153 INFO:teuthology.lock.ops:Updating [smithi138.front.sepia.ceph.com]: set os type and version on server 2024-01-21T12:13:03.153 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-01-21T12:13:03.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T12:13:03.223 DEBUG:teuthology.orchestra.run.smithi138:> true 2024-01-21T12:13:03.361 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-01-21T12:13:03.361 DEBUG:teuthology.orchestra.run.smithi138:> uname -m 2024-01-21T12:13:03.418 INFO:teuthology.orchestra.run.smithi138.stdout:x86_64 2024-01-21T12:13:03.418 DEBUG:teuthology.orchestra.run.smithi138:> cat /etc/os-release 2024-01-21T12:13:03.476 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="Red Hat Enterprise Linux" 2024-01-21T12:13:03.476 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="8.6 (Ootpa)" 2024-01-21T12:13:03.476 INFO:teuthology.orchestra.run.smithi138.stdout:ID="rhel" 2024-01-21T12:13:03.476 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE="fedora" 2024-01-21T12:13:03.476 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="8.6" 2024-01-21T12:13:03.476 INFO:teuthology.orchestra.run.smithi138.stdout:PLATFORM_ID="platform:el8" 2024-01-21T12:13:03.476 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-21T12:13:03.476 INFO:teuthology.orchestra.run.smithi138.stdout:ANSI_COLOR="0;31" 2024-01-21T12:13:03.476 INFO:teuthology.orchestra.run.smithi138.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-21T12:13:03.476 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://www.redhat.com/" 2024-01-21T12:13:03.476 INFO:teuthology.orchestra.run.smithi138.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-21T12:13:03.477 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-21T12:13:03.477 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-01-21T12:13:03.477 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-21T12:13:03.477 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-21T12:13:03.477 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-21T12:13:03.477 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-21T12:13:03.477 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server 2024-01-21T12:13:03.527 INFO:teuthology.lock.ops:Updating [smithi175.front.sepia.ceph.com]: set os type and version on server 2024-01-21T12:13:03.528 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-01-21T12:13:03.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T12:13:03.599 DEBUG:teuthology.orchestra.run.smithi175:> true 2024-01-21T12:13:03.665 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-01-21T12:13:03.665 DEBUG:teuthology.orchestra.run.smithi175:> uname -m 2024-01-21T12:13:03.726 INFO:teuthology.orchestra.run.smithi175.stdout:x86_64 2024-01-21T12:13:03.726 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release 2024-01-21T12:13:03.787 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="Red Hat Enterprise Linux" 2024-01-21T12:13:03.787 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="8.6 (Ootpa)" 2024-01-21T12:13:03.787 INFO:teuthology.orchestra.run.smithi175.stdout:ID="rhel" 2024-01-21T12:13:03.787 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="fedora" 2024-01-21T12:13:03.787 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="8.6" 2024-01-21T12:13:03.787 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el8" 2024-01-21T12:13:03.787 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-21T12:13:03.787 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31" 2024-01-21T12:13:03.787 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-21T12:13:03.787 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://www.redhat.com/" 2024-01-21T12:13:03.787 INFO:teuthology.orchestra.run.smithi175.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-21T12:13:03.787 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-21T12:13:03.788 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-01-21T12:13:03.788 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-21T12:13:03.788 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-21T12:13:03.788 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-21T12:13:03.788 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-21T12:13:03.788 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server 2024-01-21T12:13:03.819 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T12:13:03.907 INFO:teuthology.dispatcher.supervisor:Running job 7524523 2024-01-21T12:13:03.907 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-01-19_23:24:27-fs-wip-yuri4-testing-2024-01-18-1257-pacific-distro-default-smithi/7524523 --name yuriw-2024-01-19_23:24:27-fs-wip-yuri4-testing-2024-01-18-1257-pacific-distro-default-smithi --description fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} -- /home/teuthworker/archive/yuriw-2024-01-19_23:24:27-fs-wip-yuri4-testing-2024-01-18-1257-pacific-distro-default-smithi/7524523/orig.config.yaml 2024-01-21T12:13:03.910 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-01-19_23:24:27-fs-wip-yuri4-testing-2024-01-18-1257-pacific-distro-default-smithi/7524523 2024-01-21T12:13:03.910 INFO:teuthology.dispatcher.supervisor:Job PID: 3240525 2024-01-21T12:13:03.911 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-01-21T12:15:04.009 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T12:17:04.189 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T12:19:04.362 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T12:21:04.477 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T12:23:04.649 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T12:25:04.765 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T12:27:04.937 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T12:29:05.097 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T12:31:05.266 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T12:33:05.416 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T12:35:05.557 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T12:37:05.721 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T12:39:05.895 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T12:41:06.062 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T12:43:06.214 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T12:45:06.393 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T12:47:06.531 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T12:49:06.692 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T12:51:06.854 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T12:53:07.028 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T12:55:07.201 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T12:57:07.354 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T12:59:07.517 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T13:01:07.680 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T13:03:07.849 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T13:05:08.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T13:07:08.229 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T13:09:08.475 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T13:11:08.710 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T13:13:08.849 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T13:15:09.068 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T13:17:09.232 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T13:19:09.300 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T13:21:09.468 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T13:23:09.627 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T13:25:09.766 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T13:27:09.993 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T13:29:10.154 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T13:31:10.320 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T13:33:10.492 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T13:35:10.661 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T13:37:10.805 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T13:39:10.972 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T13:41:11.132 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T13:43:11.282 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T13:45:11.448 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T13:47:11.617 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T13:49:11.788 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T13:51:11.942 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T13:53:12.037 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T13:55:12.208 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T13:57:12.373 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T13:59:12.544 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T14:01:12.712 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T14:01:12.783 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-01-21T14:01:12.950 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2024-01-21T14:01:12.950 INFO:teuthology.nuke:Checking targets against current locks 2024-01-21T14:01:13.001 DEBUG:teuthology.nuke:shortname: smithi138 2024-01-21T14:01:13.002 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-21T14:01:13.019 DEBUG:teuthology.nuke:shortname: smithi175 2024-01-21T14:01:13.019 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-21T14:01:13.022 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi138.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-19_23:24:27-fs-wip-yuri4-testing-2024-01-18-1257-pacific-distro-default-smithi/7524523', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-21 12:07:58.024308', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMXSeQkU+iEgBY4BCfYlpPCNOIPVgcCFmuYgnm8XRml0x9h1YgbhNEFPtGI3fUeFN2V8LkfOhVlDTEPNvZFqfjA='} 2024-01-21T14:01:13.045 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi175.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-19_23:24:27-fs-wip-yuri4-testing-2024-01-18-1257-pacific-distro-default-smithi/7524523', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-21 12:07:58.025732', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHV0is8sIEJ3mEs6iriebN2c9giYMRZ0s5HCjVztBtE9QZNGO3N6BezvaCJ0m7EQUkcrw14VVPrO8ySc2+9k8k8='} 2024-01-21T14:01:13.068 INFO:teuthology.orchestra.console.smithi138:Power off 2024-01-21T14:01:13.069 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-21T14:01:13.094 DEBUG:teuthology.orchestra.console.smithi138:power off output: Chassis Power Control: Down/Off 2024-01-21T14:01:13.094 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-21T14:01:13.107 INFO:teuthology.orchestra.console.smithi175:Power off 2024-01-21T14:01:13.108 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-21T14:01:13.115 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off 2024-01-21T14:01:13.127 DEBUG:teuthology.orchestra.console.smithi175:power off output: Chassis Power Control: Down/Off 2024-01-21T14:01:13.128 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-21T14:01:13.148 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2024-01-21T14:01:13.216 INFO:teuthology.orchestra.console.smithi138:Power off completed 2024-01-21T14:01:13.249 INFO:teuthology.orchestra.console.smithi175:Power off completed 2024-01-21T14:01:13.364 INFO:teuthology.lock.ops:unlocked: smithi138.front.sepia.ceph.com 2024-01-21T14:01:13.397 INFO:teuthology.lock.ops:unlocked: smithi175.front.sepia.ceph.com