2023-12-13T23:59:44.215 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-13T23:59:44.215 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T23:59:44.356 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f809a5e9940>, signals=[15]) 2023-12-13T23:59:44.357 INFO:teuthology.lock.ops:Start node 'smithi001.front.sepia.ceph.com' reimaging 2023-12-13T23:59:44.357 INFO:teuthology.lock.ops:Updating [smithi001.front.sepia.ceph.com]: reset os type and version on server 2023-12-13T23:59:44.357 INFO:teuthology.lock.ops:Updating smithi001.front.sepia.ceph.com on lock server 2023-12-13T23:59:44.385 INFO:teuthology.lock.ops:Start node 'smithi156.front.sepia.ceph.com' reimaging 2023-12-13T23:59:44.385 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: reset os type and version on server 2023-12-13T23:59:44.385 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2023-12-13T23:59:44.504 DEBUG:teuthology.provision.fog.smithi001:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-13T23:59:44.524 DEBUG:teuthology.provision.fog.smithi156:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-13T23:59:44.558 INFO:teuthology.provision.fog.smithi001:Scheduling deploy of rhel 8.6 2023-12-13T23:59:44.574 INFO:teuthology.provision.fog.smithi156:Scheduling deploy of rhel 8.6 2023-12-13T23:59:44.801 INFO:teuthology.orchestra.console.smithi156:Power off 2023-12-13T23:59:44.801 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-13T23:59:44.814 INFO:teuthology.orchestra.console.smithi001:Power off 2023-12-13T23:59:44.815 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-13T23:59:44.823 DEBUG:teuthology.orchestra.console.smithi156:power off output: Chassis Power Control: Down/Off 2023-12-13T23:59:44.823 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T23:59:44.835 DEBUG:teuthology.orchestra.console.smithi001:power off output: Chassis Power Control: Down/Off 2023-12-13T23:59:44.835 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T23:59:44.843 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2023-12-13T23:59:44.856 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is off 2023-12-13T23:59:44.944 INFO:teuthology.orchestra.console.smithi156:Power off completed 2023-12-13T23:59:44.957 INFO:teuthology.orchestra.console.smithi001:Power off completed 2023-12-13T23:59:45.045 INFO:teuthology.orchestra.console.smithi156:Power on 2023-12-13T23:59:45.046 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-13T23:59:45.058 INFO:teuthology.orchestra.console.smithi001:Power on 2023-12-13T23:59:45.058 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-13T23:59:45.067 DEBUG:teuthology.orchestra.console.smithi156:power on output: Chassis Power Control: Up/On 2023-12-13T23:59:45.067 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T23:59:45.078 DEBUG:teuthology.orchestra.console.smithi001:power on output: Chassis Power Control: Up/On 2023-12-13T23:59:45.078 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T23:59:45.089 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2023-12-13T23:59:45.098 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is off 2023-12-13T23:59:49.094 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T23:59:49.101 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T23:59:49.203 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2023-12-13T23:59:49.210 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is on 2023-12-13T23:59:49.311 INFO:teuthology.orchestra.console.smithi001:Power on completed 2023-12-13T23:59:49.412 INFO:teuthology.provision.fog.smithi001:Waiting for deploy to finish 2023-12-13T23:59:53.205 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T23:59:53.315 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2023-12-13T23:59:53.416 INFO:teuthology.orchestra.console.smithi156:Power on completed 2023-12-13T23:59:53.516 INFO:teuthology.provision.fog.smithi156:Waiting for deploy to finish 2023-12-14T00:02:20.192 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T00:02:23.254 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1 2023-12-14T00:02:29.259 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T00:02:32.337 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1 2023-12-14T00:02:38.343 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T00:02:39.313 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T00:02:41.393 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1 2023-12-14T00:02:42.389 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-12-14T00:02:47.398 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T00:02:48.392 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T00:02:50.449 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1 2023-12-14T00:02:51.474 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-12-14T00:02:56.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T00:02:57.477 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T00:02:59.505 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1 2023-12-14T00:03:00.532 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-12-14T00:03:05.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T00:03:06.535 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T00:03:08.561 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1 2023-12-14T00:03:09.589 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-12-14T00:03:14.568 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T00:03:15.593 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T00:03:18.673 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-12-14T00:03:24.678 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T00:03:27.729 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-12-14T00:03:33.010 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1 2023-12-14T00:03:33.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T00:03:36.789 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-12-14T00:03:39.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T00:03:42.069 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1 2023-12-14T00:03:42.791 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T00:03:48.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T00:03:48.939 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-14T00:03:48.939 DEBUG:teuthology.orchestra.run.smithi001:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-14T00:03:49.251 INFO:teuthology.provision.fog.smithi001:Node is ready 2023-12-14T00:03:49.252 DEBUG:teuthology.orchestra.run.smithi001:> hostname 2023-12-14T00:03:49.316 INFO:teuthology.orchestra.run.smithi001.stdout:smithi022 2023-12-14T00:03:49.317 DEBUG:teuthology.orchestra.run.smithi001:> grep smithi022 /etc/hosts 2023-12-14T00:03:49.375 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2023-12-14T00:03:49.376 DEBUG:teuthology.orchestra.run.smithi001:> sudo hostname smithi001 2023-12-14T00:03:49.495 DEBUG:teuthology.orchestra.run.smithi001:> sudo sed -i -e 's/smithi022/smithi001/g' /etc/hosts 2023-12-14T00:03:49.523 DEBUG:teuthology.orchestra.run.smithi001:> sudo sed -i -e 's/172.21.15.22/172.21.15.1/g' /etc/hosts 2023-12-14T00:03:49.590 DEBUG:teuthology.orchestra.run.smithi001:> sudo sed -i -e 's/smithi022/smithi001/g' /etc/hostname 2023-12-14T00:03:49.658 DEBUG:teuthology.orchestra.run.smithi001:> sudo hostname smithi001 2023-12-14T00:03:49.726 DEBUG:teuthology.orchestra.run.smithi001:> cat /etc/os-release 2023-12-14T00:03:49.783 INFO:teuthology.orchestra.run.smithi001.stdout:NAME="Red Hat Enterprise Linux" 2023-12-14T00:03:49.783 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION="8.6 (Ootpa)" 2023-12-14T00:03:49.783 INFO:teuthology.orchestra.run.smithi001.stdout:ID="rhel" 2023-12-14T00:03:49.783 INFO:teuthology.orchestra.run.smithi001.stdout:ID_LIKE="fedora" 2023-12-14T00:03:49.783 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION_ID="8.6" 2023-12-14T00:03:49.783 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM_ID="platform:el8" 2023-12-14T00:03:49.783 INFO:teuthology.orchestra.run.smithi001.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-14T00:03:49.783 INFO:teuthology.orchestra.run.smithi001.stdout:ANSI_COLOR="0;31" 2023-12-14T00:03:49.783 INFO:teuthology.orchestra.run.smithi001.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-14T00:03:49.784 INFO:teuthology.orchestra.run.smithi001.stdout:HOME_URL="https://www.redhat.com/" 2023-12-14T00:03:49.784 INFO:teuthology.orchestra.run.smithi001.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-14T00:03:49.784 INFO:teuthology.orchestra.run.smithi001.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-14T00:03:49.784 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-14T00:03:49.784 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-14T00:03:49.784 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-14T00:03:49.784 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-14T00:03:49.784 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-14T00:03:49.785 INFO:teuthology.provision.fog.smithi001:Deploy complete! 2023-12-14T00:03:49.786 DEBUG:teuthology.parallel:result is None 2023-12-14T00:04:42.846 WARNING:teuthology.provision.fog.smithi156:timed out 2023-12-14T00:04:48.853 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T00:04:49.186 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-14T00:04:49.187 DEBUG:teuthology.orchestra.run.smithi156:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-14T00:04:49.498 INFO:teuthology.provision.fog.smithi156:Node is ready 2023-12-14T00:04:49.498 DEBUG:teuthology.orchestra.run.smithi156:> hostname 2023-12-14T00:04:49.515 INFO:teuthology.orchestra.run.smithi156.stdout:smithi156.front.sepia.ceph.com 2023-12-14T00:04:49.516 DEBUG:teuthology.orchestra.run.smithi156:> grep smithi156.front.sepia.ceph.com /etc/hosts 2023-12-14T00:04:49.573 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156 smithi156.front.sepia.ceph.com smithi156 2023-12-14T00:04:49.573 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname smithi156 2023-12-14T00:04:49.691 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi156.front.sepia.ceph.com/smithi156/g' /etc/hosts 2023-12-14T00:04:49.720 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/172.21.15.156/172.21.15.156/g' /etc/hosts 2023-12-14T00:04:49.789 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi156.front.sepia.ceph.com/smithi156/g' /etc/hostname 2023-12-14T00:04:49.856 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname smithi156 2023-12-14T00:04:49.922 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release 2023-12-14T00:04:49.980 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="Red Hat Enterprise Linux" 2023-12-14T00:04:49.980 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="8.6 (Ootpa)" 2023-12-14T00:04:49.980 INFO:teuthology.orchestra.run.smithi156.stdout:ID="rhel" 2023-12-14T00:04:49.980 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="fedora" 2023-12-14T00:04:49.981 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="8.6" 2023-12-14T00:04:49.981 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el8" 2023-12-14T00:04:49.981 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-14T00:04:49.981 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31" 2023-12-14T00:04:49.982 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-14T00:04:49.982 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://www.redhat.com/" 2023-12-14T00:04:49.982 INFO:teuthology.orchestra.run.smithi156.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-14T00:04:49.982 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-14T00:04:49.983 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-14T00:04:49.983 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-14T00:04:49.983 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-14T00:04:49.983 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-14T00:04:49.983 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-14T00:04:49.984 INFO:teuthology.provision.fog.smithi156:Deploy complete! 2023-12-14T00:04:49.984 DEBUG:teuthology.parallel:result is None 2023-12-14T00:04:50.169 INFO:teuthology.lock.ops:Checking smithi001.front.sepia.ceph.com 2023-12-14T00:04:50.170 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-14T00:04:50.204 INFO:teuthology.lock.ops:Checking smithi156.front.sepia.ceph.com 2023-12-14T00:04:50.204 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-14T00:04:50.222 INFO:teuthology.lock.ops:Updating [smithi001.front.sepia.ceph.com]: set os type and version on server 2023-12-14T00:04:50.222 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi001.front.sepia.ceph.com' 2023-12-14T00:04:50.223 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T00:04:50.291 DEBUG:teuthology.orchestra.run.smithi001:> true 2023-12-14T00:04:50.433 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi001.front.sepia.ceph.com' 2023-12-14T00:04:50.433 DEBUG:teuthology.orchestra.run.smithi001:> uname -m 2023-12-14T00:04:50.491 INFO:teuthology.orchestra.run.smithi001.stdout:x86_64 2023-12-14T00:04:50.491 DEBUG:teuthology.orchestra.run.smithi001:> cat /etc/os-release 2023-12-14T00:04:50.550 INFO:teuthology.orchestra.run.smithi001.stdout:NAME="Red Hat Enterprise Linux" 2023-12-14T00:04:50.550 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION="8.6 (Ootpa)" 2023-12-14T00:04:50.550 INFO:teuthology.orchestra.run.smithi001.stdout:ID="rhel" 2023-12-14T00:04:50.550 INFO:teuthology.orchestra.run.smithi001.stdout:ID_LIKE="fedora" 2023-12-14T00:04:50.550 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION_ID="8.6" 2023-12-14T00:04:50.550 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM_ID="platform:el8" 2023-12-14T00:04:50.551 INFO:teuthology.orchestra.run.smithi001.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-14T00:04:50.551 INFO:teuthology.orchestra.run.smithi001.stdout:ANSI_COLOR="0;31" 2023-12-14T00:04:50.551 INFO:teuthology.orchestra.run.smithi001.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-14T00:04:50.551 INFO:teuthology.orchestra.run.smithi001.stdout:HOME_URL="https://www.redhat.com/" 2023-12-14T00:04:50.551 INFO:teuthology.orchestra.run.smithi001.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-14T00:04:50.551 INFO:teuthology.orchestra.run.smithi001.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-14T00:04:50.551 INFO:teuthology.orchestra.run.smithi001.stdout: 2023-12-14T00:04:50.551 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-14T00:04:50.551 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-14T00:04:50.551 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-14T00:04:50.551 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-14T00:04:50.552 INFO:teuthology.lock.ops:Updating smithi001.front.sepia.ceph.com on lock server 2023-12-14T00:04:50.573 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: set os type and version on server 2023-12-14T00:04:50.573 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-12-14T00:04:50.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T00:04:50.640 DEBUG:teuthology.orchestra.run.smithi156:> true 2023-12-14T00:04:50.705 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-12-14T00:04:50.706 DEBUG:teuthology.orchestra.run.smithi156:> uname -m 2023-12-14T00:04:50.762 INFO:teuthology.orchestra.run.smithi156.stdout:x86_64 2023-12-14T00:04:50.763 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release 2023-12-14T00:04:50.818 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="Red Hat Enterprise Linux" 2023-12-14T00:04:50.818 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="8.6 (Ootpa)" 2023-12-14T00:04:50.818 INFO:teuthology.orchestra.run.smithi156.stdout:ID="rhel" 2023-12-14T00:04:50.818 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="fedora" 2023-12-14T00:04:50.819 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="8.6" 2023-12-14T00:04:50.819 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el8" 2023-12-14T00:04:50.819 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-14T00:04:50.819 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31" 2023-12-14T00:04:50.819 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-14T00:04:50.819 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://www.redhat.com/" 2023-12-14T00:04:50.819 INFO:teuthology.orchestra.run.smithi156.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-14T00:04:50.819 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-14T00:04:50.819 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-12-14T00:04:50.819 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-14T00:04:50.819 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-14T00:04:50.819 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-14T00:04:50.819 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-14T00:04:50.820 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2023-12-14T00:04:50.846 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T00:04:50.958 INFO:teuthology.dispatcher.supervisor:Running job 7490704 2023-12-14T00:04:50.959 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-12-13_20:38:28-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490704 --name yuriw-2023-12-13_20:38:28-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snapshots} -- /home/teuthworker/archive/yuriw-2023-12-13_20:38:28-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490704/orig.config.yaml 2023-12-14T00:04:50.963 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-12-13_20:38:28-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490704 2023-12-14T00:04:50.963 INFO:teuthology.dispatcher.supervisor:Job PID: 2574112 2023-12-14T00:04:50.963 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-14T00:06:51.065 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T00:08:51.224 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T00:10:51.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T00:12:51.570 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T00:12:51.639 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-14T00:12:51.752 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-14T00:12:51.752 INFO:teuthology.nuke:Checking targets against current locks 2023-12-14T00:12:51.803 DEBUG:teuthology.nuke:shortname: smithi001 2023-12-14T00:12:51.804 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-14T00:12:51.824 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi001.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-13_20:38:28-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490704', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-13 23:59:43.364803', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-14T00:12:51.831 DEBUG:teuthology.nuke:shortname: smithi156 2023-12-14T00:12:51.831 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-14T00:12:51.854 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi156.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-13_20:38:28-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490704', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-13 23:59:43.366341', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-14T00:12:51.879 INFO:teuthology.orchestra.console.smithi001:Power off 2023-12-14T00:12:51.880 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-14T00:12:51.902 DEBUG:teuthology.orchestra.console.smithi001:power off output: Chassis Power Control: Down/Off 2023-12-14T00:12:51.902 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T00:12:51.919 INFO:teuthology.orchestra.console.smithi156:Power off 2023-12-14T00:12:51.920 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-14T00:12:51.928 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is off 2023-12-14T00:12:51.942 DEBUG:teuthology.orchestra.console.smithi156:power off output: Chassis Power Control: Down/Off 2023-12-14T00:12:51.942 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T00:12:51.967 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2023-12-14T00:12:52.029 INFO:teuthology.orchestra.console.smithi001:Power off completed 2023-12-14T00:12:52.068 INFO:teuthology.orchestra.console.smithi156:Power off completed 2023-12-14T00:12:52.180 INFO:teuthology.lock.ops:unlocked: smithi001.front.sepia.ceph.com 2023-12-14T00:12:52.212 INFO:teuthology.lock.ops:unlocked: smithi156.front.sepia.ceph.com