2023-12-14T15:51:14.781 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-14T15:51:14.782 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T15:51:14.930 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f37d8b61940>, signals=[15]) 2023-12-14T15:51:14.931 INFO:teuthology.lock.ops:Start node 'smithi022.front.sepia.ceph.com' reimaging 2023-12-14T15:51:14.931 INFO:teuthology.lock.ops:Updating [smithi022.front.sepia.ceph.com]: reset os type and version on server 2023-12-14T15:51:14.932 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server 2023-12-14T15:51:14.952 INFO:teuthology.lock.ops:Start node 'smithi143.front.sepia.ceph.com' reimaging 2023-12-14T15:51:14.952 INFO:teuthology.lock.ops:Updating [smithi143.front.sepia.ceph.com]: reset os type and version on server 2023-12-14T15:51:14.952 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server 2023-12-14T15:51:15.082 DEBUG:teuthology.provision.fog.smithi022:Requesting image smithi_rhel_8.4 (ID 7) 2023-12-14T15:51:15.092 DEBUG:teuthology.provision.fog.smithi143:Requesting image smithi_rhel_8.4 (ID 7) 2023-12-14T15:51:15.125 INFO:teuthology.provision.fog.smithi022:Scheduling deploy of rhel 8.4 2023-12-14T15:51:15.138 INFO:teuthology.provision.fog.smithi143:Scheduling deploy of rhel 8.4 2023-12-14T15:51:15.391 INFO:teuthology.orchestra.console.smithi143:Power off 2023-12-14T15:51:15.391 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-14T15:51:15.408 INFO:teuthology.orchestra.console.smithi022:Power off 2023-12-14T15:51:15.408 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-14T15:51:15.420 DEBUG:teuthology.orchestra.console.smithi143:power off output: Chassis Power Control: Down/Off 2023-12-14T15:51:15.420 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T15:51:15.434 DEBUG:teuthology.orchestra.console.smithi022:power off output: Chassis Power Control: Down/Off 2023-12-14T15:51:15.434 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T15:51:15.450 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off 2023-12-14T15:51:15.462 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off 2023-12-14T15:51:15.551 INFO:teuthology.orchestra.console.smithi143:Power off completed 2023-12-14T15:51:15.563 INFO:teuthology.orchestra.console.smithi022:Power off completed 2023-12-14T15:51:15.652 INFO:teuthology.orchestra.console.smithi143:Power on 2023-12-14T15:51:15.653 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-14T15:51:15.665 INFO:teuthology.orchestra.console.smithi022:Power on 2023-12-14T15:51:15.665 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-14T15:51:15.680 DEBUG:teuthology.orchestra.console.smithi143:power on output: Chassis Power Control: Up/On 2023-12-14T15:51:15.680 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T15:51:15.691 DEBUG:teuthology.orchestra.console.smithi022:power on output: Chassis Power Control: Up/On 2023-12-14T15:51:15.691 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T15:51:15.706 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off 2023-12-14T15:51:15.721 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off 2023-12-14T15:51:19.711 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T15:51:19.723 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T15:51:19.825 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off 2023-12-14T15:51:19.832 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off 2023-12-14T15:51:23.831 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T15:51:23.840 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T15:51:23.942 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is on 2023-12-14T15:51:23.950 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is on 2023-12-14T15:51:24.043 INFO:teuthology.orchestra.console.smithi143:Power on completed 2023-12-14T15:51:24.051 INFO:teuthology.orchestra.console.smithi022:Power on completed 2023-12-14T15:51:24.144 INFO:teuthology.provision.fog.smithi143:Waiting for deploy to finish 2023-12-14T15:51:24.151 INFO:teuthology.provision.fog.smithi022:Waiting for deploy to finish 2023-12-14T15:53:55.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T15:53:58.321 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2023-12-14T15:54:04.326 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T15:54:07.377 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2023-12-14T15:54:10.326 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T15:54:13.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T15:54:13.394 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-12-14T15:54:16.433 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2023-12-14T15:54:19.398 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T15:54:22.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T15:54:22.449 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-12-14T15:54:25.493 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2023-12-14T15:54:28.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T15:54:31.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T15:54:31.505 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-12-14T15:54:34.581 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2023-12-14T15:54:37.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T15:54:40.561 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-12-14T15:54:40.583 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T15:54:43.638 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2023-12-14T15:54:46.565 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T15:54:49.617 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-12-14T15:54:49.639 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T15:54:55.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T15:54:58.674 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-12-14T15:55:04.678 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T15:55:14.838 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-12-14T15:55:20.844 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T15:55:23.921 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-12-14T15:55:29.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T15:55:32.978 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-12-14T15:55:38.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T15:55:39.336 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-14T15:55:39.337 DEBUG:teuthology.orchestra.run.smithi143:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-14T15:55:49.642 WARNING:teuthology.provision.fog.smithi022:timed out 2023-12-14T15:55:55.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T15:55:56.008 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-14T15:55:56.008 DEBUG:teuthology.orchestra.run.smithi022:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-14T15:55:56.267 INFO:teuthology.provision.fog.smithi022:Node is ready 2023-12-14T15:55:56.267 DEBUG:teuthology.orchestra.run.smithi022:> hostname 2023-12-14T15:55:56.283 INFO:teuthology.orchestra.run.smithi022.stdout:smithi022.front.sepia.ceph.com 2023-12-14T15:55:56.283 DEBUG:teuthology.orchestra.run.smithi022:> grep smithi022.front.sepia.ceph.com /etc/hosts 2023-12-14T15:55:56.339 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2023-12-14T15:55:56.339 DEBUG:teuthology.orchestra.run.smithi022:> sudo hostname smithi022 2023-12-14T15:55:56.451 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/smithi022.front.sepia.ceph.com/smithi022/g' /etc/hosts 2023-12-14T15:55:56.478 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/172.21.15.22/172.21.15.22/g' /etc/hosts 2023-12-14T15:55:56.544 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/smithi022.front.sepia.ceph.com/smithi022/g' /etc/hostname 2023-12-14T15:55:56.611 DEBUG:teuthology.orchestra.run.smithi022:> sudo hostname smithi022 2023-12-14T15:55:56.676 DEBUG:teuthology.orchestra.run.smithi022:> cat /etc/os-release 2023-12-14T15:55:56.732 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="Red Hat Enterprise Linux" 2023-12-14T15:55:56.732 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="8.4 (Ootpa)" 2023-12-14T15:55:56.732 INFO:teuthology.orchestra.run.smithi022.stdout:ID="rhel" 2023-12-14T15:55:56.732 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE="fedora" 2023-12-14T15:55:56.732 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="8.4" 2023-12-14T15:55:56.732 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM_ID="platform:el8" 2023-12-14T15:55:56.732 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-14T15:55:56.733 INFO:teuthology.orchestra.run.smithi022.stdout:ANSI_COLOR="0;31" 2023-12-14T15:55:56.733 INFO:teuthology.orchestra.run.smithi022.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-14T15:55:56.733 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://www.redhat.com/" 2023-12-14T15:55:56.733 INFO:teuthology.orchestra.run.smithi022.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-14T15:55:56.733 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-14T15:55:56.733 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-12-14T15:55:56.733 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-14T15:55:56.733 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-14T15:55:56.733 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-14T15:55:56.733 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-14T15:55:56.735 INFO:teuthology.provision.fog.smithi022:Deploy complete! 2023-12-14T15:55:56.736 DEBUG:teuthology.parallel:result is None 2023-12-14T15:55:59.800 INFO:teuthology.provision.fog.smithi143:Node is ready 2023-12-14T15:55:59.800 DEBUG:teuthology.orchestra.run.smithi143:> hostname 2023-12-14T15:55:59.815 INFO:teuthology.orchestra.run.smithi143.stdout:smithi036 2023-12-14T15:55:59.816 DEBUG:teuthology.orchestra.run.smithi143:> grep smithi036 /etc/hosts 2023-12-14T15:55:59.870 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.15.36 smithi036.front.sepia.ceph.com smithi036 2023-12-14T15:55:59.870 DEBUG:teuthology.orchestra.run.smithi143:> sudo hostname smithi143 2023-12-14T15:56:00.065 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i -e 's/smithi036/smithi143/g' /etc/hosts 2023-12-14T15:56:00.094 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i -e 's/172.21.15.36/172.21.15.143/g' /etc/hosts 2023-12-14T15:56:00.157 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i -e 's/smithi036/smithi143/g' /etc/hostname 2023-12-14T15:56:00.221 DEBUG:teuthology.orchestra.run.smithi143:> sudo hostname smithi143 2023-12-14T15:56:00.283 DEBUG:teuthology.orchestra.run.smithi143:> cat /etc/os-release 2023-12-14T15:56:00.337 INFO:teuthology.orchestra.run.smithi143.stdout:NAME="Red Hat Enterprise Linux" 2023-12-14T15:56:00.337 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION="8.4 (Ootpa)" 2023-12-14T15:56:00.338 INFO:teuthology.orchestra.run.smithi143.stdout:ID="rhel" 2023-12-14T15:56:00.338 INFO:teuthology.orchestra.run.smithi143.stdout:ID_LIKE="fedora" 2023-12-14T15:56:00.338 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_ID="8.4" 2023-12-14T15:56:00.338 INFO:teuthology.orchestra.run.smithi143.stdout:PLATFORM_ID="platform:el8" 2023-12-14T15:56:00.338 INFO:teuthology.orchestra.run.smithi143.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-14T15:56:00.338 INFO:teuthology.orchestra.run.smithi143.stdout:ANSI_COLOR="0;31" 2023-12-14T15:56:00.338 INFO:teuthology.orchestra.run.smithi143.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-14T15:56:00.338 INFO:teuthology.orchestra.run.smithi143.stdout:HOME_URL="https://www.redhat.com/" 2023-12-14T15:56:00.338 INFO:teuthology.orchestra.run.smithi143.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-14T15:56:00.338 INFO:teuthology.orchestra.run.smithi143.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-14T15:56:00.338 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-14T15:56:00.338 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-14T15:56:00.338 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-14T15:56:00.339 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-14T15:56:00.339 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-14T15:56:00.339 INFO:teuthology.provision.fog.smithi143:Deploy complete! 2023-12-14T15:56:00.339 DEBUG:teuthology.parallel:result is None 2023-12-14T15:56:00.555 INFO:teuthology.lock.ops:Checking smithi022.front.sepia.ceph.com 2023-12-14T15:56:00.555 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-14T15:56:00.579 INFO:teuthology.lock.ops:Checking smithi143.front.sepia.ceph.com 2023-12-14T15:56:00.580 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-14T15:56:00.597 INFO:teuthology.lock.ops:Updating [smithi022.front.sepia.ceph.com]: set os type and version on server 2023-12-14T15:56:00.597 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2023-12-14T15:56:00.598 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T15:56:00.666 DEBUG:teuthology.orchestra.run.smithi022:> true 2023-12-14T15:56:00.735 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi022.front.sepia.ceph.com' 2023-12-14T15:56:00.735 DEBUG:teuthology.orchestra.run.smithi022:> uname -m 2023-12-14T15:56:00.792 INFO:teuthology.orchestra.run.smithi022.stdout:x86_64 2023-12-14T15:56:00.792 DEBUG:teuthology.orchestra.run.smithi022:> cat /etc/os-release 2023-12-14T15:56:00.849 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="Red Hat Enterprise Linux" 2023-12-14T15:56:00.849 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="8.4 (Ootpa)" 2023-12-14T15:56:00.849 INFO:teuthology.orchestra.run.smithi022.stdout:ID="rhel" 2023-12-14T15:56:00.849 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE="fedora" 2023-12-14T15:56:00.849 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="8.4" 2023-12-14T15:56:00.849 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM_ID="platform:el8" 2023-12-14T15:56:00.850 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-14T15:56:00.850 INFO:teuthology.orchestra.run.smithi022.stdout:ANSI_COLOR="0;31" 2023-12-14T15:56:00.850 INFO:teuthology.orchestra.run.smithi022.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-14T15:56:00.850 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://www.redhat.com/" 2023-12-14T15:56:00.850 INFO:teuthology.orchestra.run.smithi022.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-14T15:56:00.850 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-14T15:56:00.850 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-12-14T15:56:00.850 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-14T15:56:00.850 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-14T15:56:00.850 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-14T15:56:00.850 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-14T15:56:00.851 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server 2023-12-14T15:56:00.881 INFO:teuthology.lock.ops:Updating [smithi143.front.sepia.ceph.com]: set os type and version on server 2023-12-14T15:56:00.881 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2023-12-14T15:56:00.882 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T15:56:00.951 DEBUG:teuthology.orchestra.run.smithi143:> true 2023-12-14T15:56:01.020 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi143.front.sepia.ceph.com' 2023-12-14T15:56:01.020 DEBUG:teuthology.orchestra.run.smithi143:> uname -m 2023-12-14T15:56:01.074 INFO:teuthology.orchestra.run.smithi143.stdout:x86_64 2023-12-14T15:56:01.075 DEBUG:teuthology.orchestra.run.smithi143:> cat /etc/os-release 2023-12-14T15:56:01.129 INFO:teuthology.orchestra.run.smithi143.stdout:NAME="Red Hat Enterprise Linux" 2023-12-14T15:56:01.129 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION="8.4 (Ootpa)" 2023-12-14T15:56:01.129 INFO:teuthology.orchestra.run.smithi143.stdout:ID="rhel" 2023-12-14T15:56:01.129 INFO:teuthology.orchestra.run.smithi143.stdout:ID_LIKE="fedora" 2023-12-14T15:56:01.129 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_ID="8.4" 2023-12-14T15:56:01.130 INFO:teuthology.orchestra.run.smithi143.stdout:PLATFORM_ID="platform:el8" 2023-12-14T15:56:01.130 INFO:teuthology.orchestra.run.smithi143.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-14T15:56:01.130 INFO:teuthology.orchestra.run.smithi143.stdout:ANSI_COLOR="0;31" 2023-12-14T15:56:01.130 INFO:teuthology.orchestra.run.smithi143.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-14T15:56:01.130 INFO:teuthology.orchestra.run.smithi143.stdout:HOME_URL="https://www.redhat.com/" 2023-12-14T15:56:01.130 INFO:teuthology.orchestra.run.smithi143.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-14T15:56:01.130 INFO:teuthology.orchestra.run.smithi143.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-14T15:56:01.130 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-12-14T15:56:01.130 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-14T15:56:01.130 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-14T15:56:01.130 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-14T15:56:01.131 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-14T15:56:01.131 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server 2023-12-14T15:56:01.247 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T15:56:01.353 INFO:teuthology.dispatcher.supervisor:Running job 7491360 2023-12-14T15:56:01.353 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-12-14_15:21:40-fs-wip-vshankar-testing3-2023-12-13-1225-quincy-distro-default-smithi/7491360 --name yuriw-2023-12-14_15:21:40-fs-wip-vshankar-testing3-2023-12-13-1225-quincy-distro-default-smithi --description fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_snaptests}} -- /home/teuthworker/archive/yuriw-2023-12-14_15:21:40-fs-wip-vshankar-testing3-2023-12-13-1225-quincy-distro-default-smithi/7491360/orig.config.yaml 2023-12-14T15:56:01.362 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-12-14_15:21:40-fs-wip-vshankar-testing3-2023-12-13-1225-quincy-distro-default-smithi/7491360 2023-12-14T15:56:01.363 INFO:teuthology.dispatcher.supervisor:Job PID: 531560 2023-12-14T15:56:01.363 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-14T15:58:01.462 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T15:58:01.542 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-14T15:58:01.677 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-14T15:58:01.678 INFO:teuthology.nuke:Checking targets against current locks 2023-12-14T15:58:01.726 DEBUG:teuthology.nuke:shortname: smithi022 2023-12-14T15:58:01.727 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-14T15:58:01.740 DEBUG:teuthology.nuke:shortname: smithi143 2023-12-14T15:58:01.740 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-14T15:58:01.749 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi022.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-14_15:21:40-fs-wip-vshankar-testing3-2023-12-13-1225-quincy-distro-default-smithi/7491360', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-14 15:51:13.856360', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOtVFzb/JXysuK7jbvXXILVW2IPGlZ8n2J69lgzxVG5phMC5/rccDSYa4FRR1F6GMjKQx9mrOWEXtANtsNoYF9E='} 2023-12-14T15:58:01.758 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi143.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-14_15:21:40-fs-wip-vshankar-testing3-2023-12-13-1225-quincy-distro-default-smithi/7491360', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-14 15:51:13.858278', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM+byeD7mQxsApWD5smhz1JJw6LdFGI8G+QITSYw8thkI4WzMkMHAmHSqL9EItSQjiNxO8qkh6TU3cJpBf1Ur44='} 2023-12-14T15:58:01.805 INFO:teuthology.orchestra.console.smithi022:Power off 2023-12-14T15:58:01.806 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-14T15:58:01.824 INFO:teuthology.orchestra.console.smithi143:Power off 2023-12-14T15:58:01.825 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-14T15:58:01.834 DEBUG:teuthology.orchestra.console.smithi022:power off output: Chassis Power Control: Down/Off 2023-12-14T15:58:01.834 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T15:58:01.849 DEBUG:teuthology.orchestra.console.smithi143:power off output: Chassis Power Control: Down/Off 2023-12-14T15:58:01.850 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T15:58:01.866 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off 2023-12-14T15:58:01.872 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off 2023-12-14T15:58:01.967 INFO:teuthology.orchestra.console.smithi022:Power off completed 2023-12-14T15:58:01.973 INFO:teuthology.orchestra.console.smithi143:Power off completed 2023-12-14T15:58:02.116 INFO:teuthology.lock.ops:unlocked: smithi022.front.sepia.ceph.com 2023-12-14T15:58:02.126 INFO:teuthology.lock.ops:unlocked: smithi143.front.sepia.ceph.com