2024-03-13T17:03:53.184 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-13T17:03:53.185 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-13T17:03:53.332 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f92f0c7fc10>, signals=[15]) 2024-03-13T17:03:53.332 INFO:teuthology.lock.ops:Start node 'smithi081.front.sepia.ceph.com' reimaging 2024-03-13T17:03:53.332 INFO:teuthology.lock.ops:Updating [smithi081.front.sepia.ceph.com]: reset os type and version on server 2024-03-13T17:03:53.332 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2024-03-13T17:03:53.357 INFO:teuthology.lock.ops:Start node 'smithi164.front.sepia.ceph.com' reimaging 2024-03-13T17:03:53.357 INFO:teuthology.lock.ops:Updating [smithi164.front.sepia.ceph.com]: reset os type and version on server 2024-03-13T17:03:53.358 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server 2024-03-13T17:03:53.487 DEBUG:teuthology.provision.fog.smithi081:Requesting image smithi_rhel_8.6 (ID 5) 2024-03-13T17:03:53.507 DEBUG:teuthology.provision.fog.smithi164:Requesting image smithi_rhel_8.6 (ID 5) 2024-03-13T17:03:53.533 INFO:teuthology.provision.fog.smithi081:Scheduling deploy of rhel 8.6 2024-03-13T17:03:53.563 INFO:teuthology.provision.fog.smithi164:Scheduling deploy of rhel 8.6 2024-03-13T17:03:53.808 INFO:teuthology.orchestra.console.smithi081:Power off 2024-03-13T17:03:53.808 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-13T17:03:53.829 DEBUG:teuthology.orchestra.console.smithi081:power off output: Chassis Power Control: Down/Off 2024-03-13T17:03:53.830 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-13T17:03:53.846 INFO:teuthology.orchestra.console.smithi164:Power off 2024-03-13T17:03:53.846 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-13T17:03:53.855 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on 2024-03-13T17:03:53.866 DEBUG:teuthology.orchestra.console.smithi164:power off output: Chassis Power Control: Down/Off 2024-03-13T17:03:53.866 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-13T17:03:53.890 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is on 2024-03-13T17:03:57.858 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-13T17:03:57.891 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-13T17:03:57.967 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on 2024-03-13T17:03:57.999 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is on 2024-03-13T17:04:01.972 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-13T17:04:02.000 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-13T17:04:02.083 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on 2024-03-13T17:04:02.109 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is off 2024-03-13T17:04:02.209 INFO:teuthology.orchestra.console.smithi164:Power off completed 2024-03-13T17:04:02.310 INFO:teuthology.orchestra.console.smithi164:Power on 2024-03-13T17:04:02.310 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-13T17:04:02.332 DEBUG:teuthology.orchestra.console.smithi164:power on output: Chassis Power Control: Up/On 2024-03-13T17:04:02.333 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-13T17:04:02.355 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is off 2024-03-13T17:04:06.089 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-13T17:04:06.197 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off 2024-03-13T17:04:06.298 INFO:teuthology.orchestra.console.smithi081:Power off completed 2024-03-13T17:04:06.356 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-13T17:04:06.399 INFO:teuthology.orchestra.console.smithi081:Power on 2024-03-13T17:04:06.399 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-13T17:04:06.422 DEBUG:teuthology.orchestra.console.smithi081:power on output: Chassis Power Control: Up/On 2024-03-13T17:04:06.422 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-13T17:04:06.440 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off 2024-03-13T17:04:06.464 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is off 2024-03-13T17:04:10.446 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-13T17:04:10.466 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-13T17:04:10.555 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off 2024-03-13T17:04:10.574 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is on 2024-03-13T17:04:10.674 INFO:teuthology.orchestra.console.smithi164:Power on completed 2024-03-13T17:04:10.775 INFO:teuthology.provision.fog.smithi164:Waiting for deploy to finish 2024-03-13T17:04:14.558 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-13T17:04:14.668 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on 2024-03-13T17:04:14.768 INFO:teuthology.orchestra.console.smithi081:Power on completed 2024-03-13T17:04:14.869 INFO:teuthology.provision.fog.smithi081:Waiting for deploy to finish 2024-03-13T17:07:01.025 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T17:07:04.098 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2024-03-13T17:07:10.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T17:07:12.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T17:07:13.186 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2024-03-13T17:07:15.070 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-03-13T17:07:19.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T17:07:21.074 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T17:07:22.270 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2024-03-13T17:07:24.126 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-03-13T17:07:28.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T17:07:30.129 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T17:07:31.326 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2024-03-13T17:07:33.186 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-03-13T17:07:37.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T17:07:39.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T17:07:40.382 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2024-03-13T17:07:42.270 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-03-13T17:07:46.387 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T17:07:48.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T17:07:49.442 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2024-03-13T17:07:51.330 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-03-13T17:07:55.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T17:07:57.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T17:08:00.386 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-03-13T17:08:06.394 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T17:08:13.982 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2024-03-13T17:08:19.989 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T17:08:23.074 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2024-03-13T17:08:29.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T17:08:32.162 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2024-03-13T17:08:38.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T17:08:38.632 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-13T17:08:38.633 DEBUG:teuthology.orchestra.run.smithi081:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-13T17:08:54.506 INFO:teuthology.provision.fog.smithi081:Node is ready 2024-03-13T17:08:54.507 DEBUG:teuthology.orchestra.run.smithi081:> hostname 2024-03-13T17:08:54.528 INFO:teuthology.orchestra.run.smithi081.stdout:smithi081.front.sepia.ceph.com 2024-03-13T17:08:54.528 DEBUG:teuthology.orchestra.run.smithi081:> grep smithi081.front.sepia.ceph.com /etc/hosts 2024-03-13T17:08:54.589 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81 smithi081.front.sepia.ceph.com smithi081 2024-03-13T17:08:54.589 DEBUG:teuthology.orchestra.run.smithi081:> sudo hostname smithi081 2024-03-13T17:08:54.719 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/smithi081.front.sepia.ceph.com/smithi081/g' /etc/hosts 2024-03-13T17:08:54.751 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/172.21.15.81/172.21.15.81/g' /etc/hosts 2024-03-13T17:08:54.821 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/smithi081.front.sepia.ceph.com/smithi081/g' /etc/hostname 2024-03-13T17:08:54.890 DEBUG:teuthology.orchestra.run.smithi081:> sudo hostname smithi081 2024-03-13T17:08:54.957 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2024-03-13T17:08:55.014 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="Red Hat Enterprise Linux" 2024-03-13T17:08:55.014 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="8.6 (Ootpa)" 2024-03-13T17:08:55.014 INFO:teuthology.orchestra.run.smithi081.stdout:ID="rhel" 2024-03-13T17:08:55.014 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="fedora" 2024-03-13T17:08:55.014 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="8.6" 2024-03-13T17:08:55.014 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el8" 2024-03-13T17:08:55.014 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-03-13T17:08:55.014 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31" 2024-03-13T17:08:55.015 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-03-13T17:08:55.015 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://www.redhat.com/" 2024-03-13T17:08:55.015 INFO:teuthology.orchestra.run.smithi081.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-03-13T17:08:55.015 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-13T17:08:55.015 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-13T17:08:55.015 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-13T17:08:55.015 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-03-13T17:08:55.015 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-03-13T17:08:55.015 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-03-13T17:08:55.016 INFO:teuthology.provision.fog.smithi081:Deploy complete! 2024-03-13T17:08:55.017 DEBUG:teuthology.parallel:result is None 2024-03-13T17:09:06.407 WARNING:teuthology.provision.fog.smithi164:timed out 2024-03-13T17:09:12.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T17:09:12.719 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-13T17:09:12.719 DEBUG:teuthology.orchestra.run.smithi164:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-13T17:09:12.992 INFO:teuthology.provision.fog.smithi164:Node is ready 2024-03-13T17:09:12.992 DEBUG:teuthology.orchestra.run.smithi164:> hostname 2024-03-13T17:09:13.010 INFO:teuthology.orchestra.run.smithi164.stdout:smithi164.front.sepia.ceph.com 2024-03-13T17:09:13.010 DEBUG:teuthology.orchestra.run.smithi164:> grep smithi164.front.sepia.ceph.com /etc/hosts 2024-03-13T17:09:13.068 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.15.164 smithi164.front.sepia.ceph.com smithi164 2024-03-13T17:09:13.069 DEBUG:teuthology.orchestra.run.smithi164:> sudo hostname smithi164 2024-03-13T17:09:13.174 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i -e 's/smithi164.front.sepia.ceph.com/smithi164/g' /etc/hosts 2024-03-13T17:09:13.202 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i -e 's/172.21.15.164/172.21.15.164/g' /etc/hosts 2024-03-13T17:09:13.270 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i -e 's/smithi164.front.sepia.ceph.com/smithi164/g' /etc/hostname 2024-03-13T17:09:13.337 DEBUG:teuthology.orchestra.run.smithi164:> sudo hostname smithi164 2024-03-13T17:09:13.403 DEBUG:teuthology.orchestra.run.smithi164:> cat /etc/os-release 2024-03-13T17:09:13.460 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="Red Hat Enterprise Linux" 2024-03-13T17:09:13.460 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="8.6 (Ootpa)" 2024-03-13T17:09:13.460 INFO:teuthology.orchestra.run.smithi164.stdout:ID="rhel" 2024-03-13T17:09:13.460 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE="fedora" 2024-03-13T17:09:13.460 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="8.6" 2024-03-13T17:09:13.460 INFO:teuthology.orchestra.run.smithi164.stdout:PLATFORM_ID="platform:el8" 2024-03-13T17:09:13.460 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-03-13T17:09:13.460 INFO:teuthology.orchestra.run.smithi164.stdout:ANSI_COLOR="0;31" 2024-03-13T17:09:13.461 INFO:teuthology.orchestra.run.smithi164.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-03-13T17:09:13.461 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://www.redhat.com/" 2024-03-13T17:09:13.461 INFO:teuthology.orchestra.run.smithi164.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-03-13T17:09:13.461 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-13T17:09:13.461 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-13T17:09:13.461 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-13T17:09:13.461 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-03-13T17:09:13.461 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-03-13T17:09:13.461 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-03-13T17:09:13.461 INFO:teuthology.provision.fog.smithi164:Deploy complete! 2024-03-13T17:09:13.462 DEBUG:teuthology.parallel:result is None 2024-03-13T17:09:13.615 INFO:teuthology.lock.ops:Checking smithi081.front.sepia.ceph.com 2024-03-13T17:09:13.615 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-13T17:09:13.635 INFO:teuthology.lock.ops:Checking smithi164.front.sepia.ceph.com 2024-03-13T17:09:13.635 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-13T17:09:13.661 INFO:teuthology.lock.ops:Updating [smithi081.front.sepia.ceph.com]: set os type and version on server 2024-03-13T17:09:13.661 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-03-13T17:09:13.662 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T17:09:13.735 DEBUG:teuthology.orchestra.run.smithi081:> true 2024-03-13T17:09:13.872 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-03-13T17:09:13.872 DEBUG:teuthology.orchestra.run.smithi081:> uname -m 2024-03-13T17:09:13.929 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64 2024-03-13T17:09:13.929 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2024-03-13T17:09:13.986 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="Red Hat Enterprise Linux" 2024-03-13T17:09:13.986 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="8.6 (Ootpa)" 2024-03-13T17:09:13.986 INFO:teuthology.orchestra.run.smithi081.stdout:ID="rhel" 2024-03-13T17:09:13.986 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="fedora" 2024-03-13T17:09:13.986 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="8.6" 2024-03-13T17:09:13.986 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el8" 2024-03-13T17:09:13.986 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-03-13T17:09:13.986 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31" 2024-03-13T17:09:13.987 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-03-13T17:09:13.987 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://www.redhat.com/" 2024-03-13T17:09:13.987 INFO:teuthology.orchestra.run.smithi081.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-03-13T17:09:13.987 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-13T17:09:13.987 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-13T17:09:13.987 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-13T17:09:13.987 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-03-13T17:09:13.987 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-03-13T17:09:13.987 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-03-13T17:09:13.988 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2024-03-13T17:09:14.010 INFO:teuthology.lock.ops:Updating [smithi164.front.sepia.ceph.com]: set os type and version on server 2024-03-13T17:09:14.010 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-03-13T17:09:14.010 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T17:09:14.080 DEBUG:teuthology.orchestra.run.smithi164:> true 2024-03-13T17:09:14.152 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-03-13T17:09:14.152 DEBUG:teuthology.orchestra.run.smithi164:> uname -m 2024-03-13T17:09:14.209 INFO:teuthology.orchestra.run.smithi164.stdout:x86_64 2024-03-13T17:09:14.209 DEBUG:teuthology.orchestra.run.smithi164:> cat /etc/os-release 2024-03-13T17:09:14.266 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="Red Hat Enterprise Linux" 2024-03-13T17:09:14.266 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="8.6 (Ootpa)" 2024-03-13T17:09:14.266 INFO:teuthology.orchestra.run.smithi164.stdout:ID="rhel" 2024-03-13T17:09:14.266 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE="fedora" 2024-03-13T17:09:14.267 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="8.6" 2024-03-13T17:09:14.267 INFO:teuthology.orchestra.run.smithi164.stdout:PLATFORM_ID="platform:el8" 2024-03-13T17:09:14.267 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-03-13T17:09:14.267 INFO:teuthology.orchestra.run.smithi164.stdout:ANSI_COLOR="0;31" 2024-03-13T17:09:14.267 INFO:teuthology.orchestra.run.smithi164.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-03-13T17:09:14.267 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://www.redhat.com/" 2024-03-13T17:09:14.267 INFO:teuthology.orchestra.run.smithi164.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-03-13T17:09:14.267 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-13T17:09:14.267 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-13T17:09:14.267 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-13T17:09:14.267 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-03-13T17:09:14.267 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-03-13T17:09:14.267 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-03-13T17:09:14.268 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server 2024-03-13T17:09:14.284 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-13T17:09:14.384 INFO:teuthology.dispatcher.supervisor:Running job 7596768 2024-03-13T17:09:14.384 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-03-13_14:13:21-fs-wip-yuri-testing-2024-03-12-1240-reef-distro-default-smithi/7596768 --name yuriw-2024-03-13_14:13:21-fs-wip-yuri-testing-2024-03-12-1240-reef-distro-default-smithi --description fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} -- /home/teuthworker/archive/yuriw-2024-03-13_14:13:21-fs-wip-yuri-testing-2024-03-12-1240-reef-distro-default-smithi/7596768/orig.config.yaml 2024-03-13T17:09:14.387 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-03-13_14:13:21-fs-wip-yuri-testing-2024-03-12-1240-reef-distro-default-smithi/7596768 2024-03-13T17:09:14.388 INFO:teuthology.dispatcher.supervisor:Job PID: 2783335 2024-03-13T17:09:14.388 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-13T17:11:14.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-13T17:13:14.662 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-13T17:15:14.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-13T17:17:15.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-13T17:19:15.175 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-13T17:21:15.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-13T17:21:15.414 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-03-13T17:21:15.523 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi081 but it was locked by another job: /home/teuthworker/archive/yuriw-2024-03-13_14:13:21-fs-wip-yuri-testing-2024-03-12-1240-reef-distro-default-smithi/7596797 2024-03-13T17:21:15.523 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi164 but it was locked by another job: /home/teuthworker/archive/yuriw-2024-03-13_14:13:21-fs-wip-yuri-testing-2024-03-12-1240-reef-distro-default-smithi/7596799