2023-12-19T14:56:08.136 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e
2023-12-19T14:56:08.136 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T14:56:08.272 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f0a63142550>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f0a6408b940>, signals=[15])
2023-12-19T14:56:08.273 INFO:teuthology.lock.ops:Start node 'smithi029.front.sepia.ceph.com' reimaging
2023-12-19T14:56:08.273 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: reset os type and version on server
2023-12-19T14:56:08.273 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server
2023-12-19T14:56:08.294 INFO:teuthology.lock.ops:Start node 'smithi052.front.sepia.ceph.com' reimaging
2023-12-19T14:56:08.294 INFO:teuthology.lock.ops:Updating [smithi052.front.sepia.ceph.com]: reset os type and version on server
2023-12-19T14:56:08.294 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server
2023-12-19T14:56:08.429 DEBUG:teuthology.provision.fog.smithi029:Requesting image smithi_rhel_8.4 (ID 7)
2023-12-19T14:56:08.437 DEBUG:teuthology.provision.fog.smithi052:Requesting image smithi_rhel_8.4 (ID 7)
2023-12-19T14:56:08.479 INFO:teuthology.provision.fog.smithi029:Scheduling deploy of rhel 8.4
2023-12-19T14:56:08.484 INFO:teuthology.provision.fog.smithi052:Scheduling deploy of rhel 8.4
2023-12-19T14:56:08.851 INFO:teuthology.orchestra.console.smithi052:Power off
2023-12-19T14:56:08.852 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-19T14:56:08.865 INFO:teuthology.orchestra.console.smithi029:Power off
2023-12-19T14:56:08.866 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-19T14:56:08.878 DEBUG:teuthology.orchestra.console.smithi052:power off output: Chassis Power Control: Down/Off
2023-12-19T14:56:08.878 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T14:56:08.891 DEBUG:teuthology.orchestra.console.smithi029:power off output: Chassis Power Control: Down/Off
2023-12-19T14:56:08.891 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T14:56:08.899 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is off
2023-12-19T14:56:08.915 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off
2023-12-19T14:56:09.000 INFO:teuthology.orchestra.console.smithi052:Power off completed
2023-12-19T14:56:09.016 INFO:teuthology.orchestra.console.smithi029:Power off completed
2023-12-19T14:56:09.101 INFO:teuthology.orchestra.console.smithi052:Power on
2023-12-19T14:56:09.101 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-19T14:56:09.116 INFO:teuthology.orchestra.console.smithi029:Power on
2023-12-19T14:56:09.117 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-19T14:56:09.125 DEBUG:teuthology.orchestra.console.smithi052:power on output: Chassis Power Control: Up/On
2023-12-19T14:56:09.126 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T14:56:09.138 DEBUG:teuthology.orchestra.console.smithi029:power on output: Chassis Power Control: Up/On
2023-12-19T14:56:09.139 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T14:56:09.147 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is off
2023-12-19T14:56:09.158 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off
2023-12-19T14:56:13.149 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T14:56:13.159 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T14:56:13.262 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is on
2023-12-19T14:56:13.268 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is on
2023-12-19T14:56:13.363 INFO:teuthology.orchestra.console.smithi052:Power on completed
2023-12-19T14:56:13.369 INFO:teuthology.orchestra.console.smithi029:Power on completed
2023-12-19T14:56:13.464 INFO:teuthology.provision.fog.smithi052:Waiting for deploy to finish
2023-12-19T14:56:13.470 INFO:teuthology.provision.fog.smithi029:Waiting for deploy to finish
2023-12-19T14:58:44.492 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T14:58:47.569 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52
2023-12-19T14:58:53.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T14:58:56.625 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52
2023-12-19T14:59:02.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T14:59:05.685 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52
2023-12-19T14:59:11.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T14:59:14.769 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52
2023-12-19T14:59:20.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T14:59:23.825 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52
2023-12-19T14:59:29.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T14:59:29.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T14:59:32.753 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29
2023-12-19T14:59:32.881 WARNING:teuthology.provision.fog.smithi052:[Errno None] Unable to connect to port 22 on 172.21.15.52
2023-12-19T14:59:38.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T14:59:38.883 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T14:59:41.809 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29
2023-12-19T14:59:47.814 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T14:59:50.869 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29
2023-12-19T14:59:56.874 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T14:59:59.953 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29
2023-12-19T15:00:05.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T15:00:09.010 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29
2023-12-19T15:00:15.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T15:00:38.906 WARNING:teuthology.provision.fog.smithi052:timed out
2023-12-19T15:00:44.913 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T15:00:45.228 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-19T15:00:45.228 DEBUG:teuthology.orchestra.run.smithi052:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-19T15:00:45.553 INFO:teuthology.provision.fog.smithi052:Node is ready
2023-12-19T15:00:45.553 DEBUG:teuthology.orchestra.run.smithi052:> hostname
2023-12-19T15:00:45.567 INFO:teuthology.orchestra.run.smithi052.stdout:smithi052.front.sepia.ceph.com
2023-12-19T15:00:45.567 DEBUG:teuthology.orchestra.run.smithi052:> grep smithi052.front.sepia.ceph.com /etc/hosts
2023-12-19T15:00:45.621 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52 smithi052.front.sepia.ceph.com smithi052
2023-12-19T15:00:45.622 DEBUG:teuthology.orchestra.run.smithi052:> sudo hostname smithi052
2023-12-19T15:00:45.730 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i -e 's/smithi052.front.sepia.ceph.com/smithi052/g' /etc/hosts
2023-12-19T15:00:45.754 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i -e 's/172.21.15.52/172.21.15.52/g' /etc/hosts
2023-12-19T15:00:45.819 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i -e 's/smithi052.front.sepia.ceph.com/smithi052/g' /etc/hostname
2023-12-19T15:00:45.884 DEBUG:teuthology.orchestra.run.smithi052:> sudo hostname smithi052
2023-12-19T15:00:45.949 DEBUG:teuthology.orchestra.run.smithi052:> cat /etc/os-release
2023-12-19T15:00:46.008 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="Red Hat Enterprise Linux"
2023-12-19T15:00:46.008 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="8.4 (Ootpa)"
2023-12-19T15:00:46.008 INFO:teuthology.orchestra.run.smithi052.stdout:ID="rhel"
2023-12-19T15:00:46.008 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE="fedora"
2023-12-19T15:00:46.008 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="8.4"
2023-12-19T15:00:46.008 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM_ID="platform:el8"
2023-12-19T15:00:46.008 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-12-19T15:00:46.008 INFO:teuthology.orchestra.run.smithi052.stdout:ANSI_COLOR="0;31"
2023-12-19T15:00:46.008 INFO:teuthology.orchestra.run.smithi052.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-12-19T15:00:46.008 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://www.redhat.com/"
2023-12-19T15:00:46.009 INFO:teuthology.orchestra.run.smithi052.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-19T15:00:46.009 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-19T15:00:46.009 INFO:teuthology.orchestra.run.smithi052.stdout:
2023-12-19T15:00:46.009 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-19T15:00:46.009 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-12-19T15:00:46.009 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-19T15:00:46.009 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-12-19T15:00:46.010 INFO:teuthology.provision.fog.smithi052:Deploy complete!
2023-12-19T15:00:46.011 DEBUG:teuthology.parallel:result is None
2023-12-19T15:01:15.046 WARNING:teuthology.provision.fog.smithi029:timed out
2023-12-19T15:01:21.050 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T15:01:21.528 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-19T15:01:21.528 DEBUG:teuthology.orchestra.run.smithi029:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-19T15:01:26.850 INFO:teuthology.provision.fog.smithi029:Node is ready
2023-12-19T15:01:26.850 DEBUG:teuthology.orchestra.run.smithi029:> hostname
2023-12-19T15:01:26.875 INFO:teuthology.orchestra.run.smithi029.stdout:smithi029.front.sepia.ceph.com
2023-12-19T15:01:26.876 DEBUG:teuthology.orchestra.run.smithi029:> grep smithi029.front.sepia.ceph.com /etc/hosts
2023-12-19T15:01:26.932 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29 smithi029.front.sepia.ceph.com smithi029
2023-12-19T15:01:26.933 DEBUG:teuthology.orchestra.run.smithi029:> sudo hostname smithi029
2023-12-19T15:01:27.134 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/smithi029.front.sepia.ceph.com/smithi029/g' /etc/hosts
2023-12-19T15:01:27.162 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/172.21.15.29/172.21.15.29/g' /etc/hosts
2023-12-19T15:01:27.229 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/smithi029.front.sepia.ceph.com/smithi029/g' /etc/hostname
2023-12-19T15:01:27.295 DEBUG:teuthology.orchestra.run.smithi029:> sudo hostname smithi029
2023-12-19T15:01:27.360 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release
2023-12-19T15:01:27.415 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="Red Hat Enterprise Linux"
2023-12-19T15:01:27.415 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="8.4 (Ootpa)"
2023-12-19T15:01:27.415 INFO:teuthology.orchestra.run.smithi029.stdout:ID="rhel"
2023-12-19T15:01:27.415 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="fedora"
2023-12-19T15:01:27.415 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="8.4"
2023-12-19T15:01:27.415 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el8"
2023-12-19T15:01:27.415 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-12-19T15:01:27.415 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31"
2023-12-19T15:01:27.416 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-12-19T15:01:27.416 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://www.redhat.com/"
2023-12-19T15:01:27.416 INFO:teuthology.orchestra.run.smithi029.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-19T15:01:27.416 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-19T15:01:27.416 INFO:teuthology.orchestra.run.smithi029.stdout:
2023-12-19T15:01:27.416 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-19T15:01:27.416 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-12-19T15:01:27.416 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-19T15:01:27.416 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-12-19T15:01:27.416 INFO:teuthology.provision.fog.smithi029:Deploy complete!
2023-12-19T15:01:27.417 DEBUG:teuthology.parallel:result is None
2023-12-19T15:01:27.575 INFO:teuthology.lock.ops:Checking smithi029.front.sepia.ceph.com
2023-12-19T15:01:27.575 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-19T15:01:27.601 INFO:teuthology.lock.ops:Checking smithi052.front.sepia.ceph.com
2023-12-19T15:01:27.601 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-19T15:01:27.627 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: set os type and version on server
2023-12-19T15:01:27.627 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com'
2023-12-19T15:01:27.628 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T15:01:27.693 DEBUG:teuthology.orchestra.run.smithi029:> true
2023-12-19T15:01:27.760 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi029.front.sepia.ceph.com'
2023-12-19T15:01:27.760 DEBUG:teuthology.orchestra.run.smithi029:> uname -m
2023-12-19T15:01:27.814 INFO:teuthology.orchestra.run.smithi029.stdout:x86_64
2023-12-19T15:01:27.815 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release
2023-12-19T15:01:27.868 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="Red Hat Enterprise Linux"
2023-12-19T15:01:27.869 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="8.4 (Ootpa)"
2023-12-19T15:01:27.869 INFO:teuthology.orchestra.run.smithi029.stdout:ID="rhel"
2023-12-19T15:01:27.869 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="fedora"
2023-12-19T15:01:27.869 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="8.4"
2023-12-19T15:01:27.869 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el8"
2023-12-19T15:01:27.869 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-12-19T15:01:27.869 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31"
2023-12-19T15:01:27.869 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-12-19T15:01:27.869 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://www.redhat.com/"
2023-12-19T15:01:27.869 INFO:teuthology.orchestra.run.smithi029.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-19T15:01:27.869 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-19T15:01:27.869 INFO:teuthology.orchestra.run.smithi029.stdout:
2023-12-19T15:01:27.869 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-19T15:01:27.870 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-12-19T15:01:27.870 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-19T15:01:27.870 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-12-19T15:01:27.870 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server
2023-12-19T15:01:27.893 INFO:teuthology.lock.ops:Updating [smithi052.front.sepia.ceph.com]: set os type and version on server
2023-12-19T15:01:27.893 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com'
2023-12-19T15:01:27.893 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-19T15:01:27.967 DEBUG:teuthology.orchestra.run.smithi052:> true
2023-12-19T15:01:28.093 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi052.front.sepia.ceph.com'
2023-12-19T15:01:28.093 DEBUG:teuthology.orchestra.run.smithi052:> uname -m
2023-12-19T15:01:28.149 INFO:teuthology.orchestra.run.smithi052.stdout:x86_64
2023-12-19T15:01:28.149 DEBUG:teuthology.orchestra.run.smithi052:> cat /etc/os-release
2023-12-19T15:01:28.205 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="Red Hat Enterprise Linux"
2023-12-19T15:01:28.205 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="8.4 (Ootpa)"
2023-12-19T15:01:28.205 INFO:teuthology.orchestra.run.smithi052.stdout:ID="rhel"
2023-12-19T15:01:28.205 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE="fedora"
2023-12-19T15:01:28.205 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="8.4"
2023-12-19T15:01:28.205 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM_ID="platform:el8"
2023-12-19T15:01:28.205 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-12-19T15:01:28.205 INFO:teuthology.orchestra.run.smithi052.stdout:ANSI_COLOR="0;31"
2023-12-19T15:01:28.206 INFO:teuthology.orchestra.run.smithi052.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-12-19T15:01:28.206 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://www.redhat.com/"
2023-12-19T15:01:28.206 INFO:teuthology.orchestra.run.smithi052.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-19T15:01:28.206 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-19T15:01:28.206 INFO:teuthology.orchestra.run.smithi052.stdout:
2023-12-19T15:01:28.206 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-19T15:01:28.206 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-12-19T15:01:28.206 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-19T15:01:28.206 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-12-19T15:01:28.207 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server
2023-12-19T15:01:28.226 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T15:01:28.318 INFO:teuthology.dispatcher.supervisor:Running job 7496955
2023-12-19T15:01:28.318 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-12-19_12:25:28-fs-rishabh-mdscap-quincy-testing-default-smithi/7496955 --name rishabh-2023-12-19_12:25:28-fs-rishabh-mdscap-quincy-testing-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mds 2-workunit/suites/ffsb}} -- /home/teuthworker/archive/rishabh-2023-12-19_12:25:28-fs-rishabh-mdscap-quincy-testing-default-smithi/7496955/orig.config.yaml
2023-12-19T15:01:28.322 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-12-19_12:25:28-fs-rishabh-mdscap-quincy-testing-default-smithi/7496955
2023-12-19T15:01:28.322 INFO:teuthology.dispatcher.supervisor:Job PID: 2475447
2023-12-19T15:01:28.322 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-12-19T15:03:28.423 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T15:05:28.594 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T15:07:28.765 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T15:09:28.938 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T15:11:29.111 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T15:13:29.287 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T15:15:29.478 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T15:17:29.650 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-19T15:17:29.717 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-12-19T15:17:29.845 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-12-19T15:17:29.846 INFO:teuthology.nuke:Checking targets against current locks
2023-12-19T15:17:29.892 DEBUG:teuthology.nuke:shortname: smithi029
2023-12-19T15:17:29.892 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-19T15:17:29.917 DEBUG:teuthology.nuke:shortname: smithi052
2023-12-19T15:17:29.917 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-19T15:17:29.918 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi029.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-19_12:25:28-fs-rishabh-mdscap-quincy-testing-default-smithi/7496955', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 14:56:07.277829', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLFUmQyiWEdcYUF6nNorLv9tlE7DU7V42ED5Ej3v5u2FQnwpx2U3+YP61cmcr/rI3bW4bWv1uQC1kkA8ui8ojVU='}
2023-12-19T15:17:29.940 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi052.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-19_12:25:28-fs-rishabh-mdscap-quincy-testing-default-smithi/7496955', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 14:56:07.279342', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEn25/BtvTQ81jhzU/49rXZAR/bLzzFsyIrVEHJRci6se7MJL59h9bv6+TdbAyDmBCEFzAETbbzN5CLBmAuzhOs='}
2023-12-19T15:17:29.974 INFO:teuthology.orchestra.console.smithi029:Power off
2023-12-19T15:17:29.974 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-19T15:17:30.016 INFO:teuthology.orchestra.console.smithi052:Power off
2023-12-19T15:17:30.017 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-19T15:17:30.028 DEBUG:teuthology.orchestra.console.smithi029:power off output: Chassis Power Control: Down/Off
2023-12-19T15:17:30.029 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T15:17:30.046 DEBUG:teuthology.orchestra.console.smithi052:power off output: Chassis Power Control: Down/Off
2023-12-19T15:17:30.047 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-19T15:17:30.058 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off
2023-12-19T15:17:30.069 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is off
2023-12-19T15:17:30.159 INFO:teuthology.orchestra.console.smithi029:Power off completed
2023-12-19T15:17:30.170 INFO:teuthology.orchestra.console.smithi052:Power off completed
2023-12-19T15:17:30.359 INFO:teuthology.lock.ops:unlocked: smithi029.front.sepia.ceph.com
2023-12-19T15:17:30.397 INFO:teuthology.lock.ops:unlocked: smithi052.front.sepia.ceph.com