2024-01-23T15:48:28.938 INFO:root:teuthology version: 0.0.1.dev251+gc856e0f
2024-01-23T15:48:28.938 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-23T15:48:29.088 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f2bfa058f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f2bfb0bec10>, signals=[15])
2024-01-23T15:48:29.089 INFO:teuthology.lock.ops:Start node 'smithi031.front.sepia.ceph.com' reimaging
2024-01-23T15:48:29.089 INFO:teuthology.lock.ops:Updating [smithi031.front.sepia.ceph.com]: reset os type and version on server
2024-01-23T15:48:29.089 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server
2024-01-23T15:48:29.108 INFO:teuthology.lock.ops:Start node 'smithi159.front.sepia.ceph.com' reimaging
2024-01-23T15:48:29.109 INFO:teuthology.lock.ops:Updating [smithi159.front.sepia.ceph.com]: reset os type and version on server
2024-01-23T15:48:29.109 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server
2024-01-23T15:48:29.229 DEBUG:teuthology.provision.fog.smithi031:Requesting image smithi_rhel_8.6 (ID 5)
2024-01-23T15:48:29.251 DEBUG:teuthology.provision.fog.smithi159:Requesting image smithi_rhel_8.6 (ID 5)
2024-01-23T15:48:29.284 INFO:teuthology.provision.fog.smithi031:Scheduling deploy of rhel 8.6
2024-01-23T15:48:29.298 INFO:teuthology.provision.fog.smithi159:Scheduling deploy of rhel 8.6
2024-01-23T15:48:29.514 INFO:teuthology.orchestra.console.smithi031:Power off
2024-01-23T15:48:29.514 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-23T15:48:29.529 INFO:teuthology.orchestra.console.smithi159:Power off
2024-01-23T15:48:29.529 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-23T15:48:29.537 DEBUG:teuthology.orchestra.console.smithi031:power off output: Chassis Power Control: Down/Off
2024-01-23T15:48:29.538 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-23T15:48:29.551 DEBUG:teuthology.orchestra.console.smithi159:power off output: Chassis Power Control: Down/Off
2024-01-23T15:48:29.551 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-23T15:48:29.559 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off
2024-01-23T15:48:29.573 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off
2024-01-23T15:48:29.660 INFO:teuthology.orchestra.console.smithi031:Power off completed
2024-01-23T15:48:29.674 INFO:teuthology.orchestra.console.smithi159:Power off completed
2024-01-23T15:48:29.762 INFO:teuthology.orchestra.console.smithi031:Power on
2024-01-23T15:48:29.762 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-23T15:48:29.775 INFO:teuthology.orchestra.console.smithi159:Power on
2024-01-23T15:48:29.775 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-23T15:48:29.784 DEBUG:teuthology.orchestra.console.smithi031:power on output: Chassis Power Control: Up/On
2024-01-23T15:48:29.784 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-23T15:48:29.797 DEBUG:teuthology.orchestra.console.smithi159:power on output: Chassis Power Control: Up/On
2024-01-23T15:48:29.797 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-23T15:48:29.805 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off
2024-01-23T15:48:29.820 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off
2024-01-23T15:48:33.809 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-23T15:48:33.821 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-23T15:48:33.917 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on
2024-01-23T15:48:33.930 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off
2024-01-23T15:48:34.019 INFO:teuthology.orchestra.console.smithi031:Power on completed
2024-01-23T15:48:34.119 INFO:teuthology.provision.fog.smithi031:Waiting for deploy to finish
2024-01-23T15:48:37.935 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-23T15:48:38.044 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is on
2024-01-23T15:48:38.144 INFO:teuthology.orchestra.console.smithi159:Power on completed
2024-01-23T15:48:38.245 INFO:teuthology.provision.fog.smithi159:Waiting for deploy to finish
2024-01-23T15:51:04.869 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-23T15:51:07.932 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31
2024-01-23T15:51:13.936 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-23T15:51:16.992 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31
2024-01-23T15:51:22.997 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-23T15:51:23.984 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-23T15:51:26.076 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31
2024-01-23T15:51:27.036 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2024-01-23T15:51:32.083 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-23T15:51:33.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-23T15:51:35.164 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31
2024-01-23T15:51:36.092 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2024-01-23T15:51:41.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-23T15:51:42.094 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-23T15:51:44.220 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31
2024-01-23T15:51:45.148 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2024-01-23T15:51:50.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-23T15:51:51.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-23T15:51:54.204 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2024-01-23T15:52:00.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-23T15:52:03.260 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2024-01-23T15:52:08.764 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31
2024-01-23T15:52:09.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-23T15:52:12.316 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2024-01-23T15:52:14.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-23T15:52:17.820 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31
2024-01-23T15:52:18.318 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-23T15:52:21.372 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2024-01-23T15:52:23.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-23T15:52:26.876 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31
2024-01-23T15:52:27.373 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-23T15:52:32.883 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-23T15:52:33.226 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-23T15:52:33.226 DEBUG:teuthology.orchestra.run.smithi031:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-23T15:52:43.229 INFO:teuthology.provision.fog.smithi031:Node is ready
2024-01-23T15:52:43.230 DEBUG:teuthology.orchestra.run.smithi031:> hostname
2024-01-23T15:52:43.252 INFO:teuthology.orchestra.run.smithi031.stdout:smithi045
2024-01-23T15:52:43.253 DEBUG:teuthology.orchestra.run.smithi031:> grep smithi045 /etc/hosts
2024-01-23T15:52:43.314 DEBUG:teuthology.orchestra.run:got remote process result: 1
2024-01-23T15:52:43.314 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/smithi045/smithi031/g' /etc/hostname
2024-01-23T15:52:43.436 DEBUG:teuthology.orchestra.run.smithi031:> sudo hostname smithi031
2024-01-23T15:52:43.469 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release
2024-01-23T15:52:43.530 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="Red Hat Enterprise Linux"
2024-01-23T15:52:43.530 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="8.6 (Ootpa)"
2024-01-23T15:52:43.530 INFO:teuthology.orchestra.run.smithi031.stdout:ID="rhel"
2024-01-23T15:52:43.531 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE="fedora"
2024-01-23T15:52:43.531 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="8.6"
2024-01-23T15:52:43.531 INFO:teuthology.orchestra.run.smithi031.stdout:PLATFORM_ID="platform:el8"
2024-01-23T15:52:43.531 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-01-23T15:52:43.531 INFO:teuthology.orchestra.run.smithi031.stdout:ANSI_COLOR="0;31"
2024-01-23T15:52:43.531 INFO:teuthology.orchestra.run.smithi031.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-01-23T15:52:43.531 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://www.redhat.com/"
2024-01-23T15:52:43.531 INFO:teuthology.orchestra.run.smithi031.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-01-23T15:52:43.531 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-23T15:52:43.531 INFO:teuthology.orchestra.run.smithi031.stdout:
2024-01-23T15:52:43.531 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-23T15:52:43.531 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-01-23T15:52:43.531 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-01-23T15:52:43.531 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-01-23T15:52:43.532 INFO:teuthology.provision.fog.smithi031:Deploy complete!
2024-01-23T15:52:43.534 DEBUG:teuthology.parallel:result is None
2024-01-23T15:53:27.419 WARNING:teuthology.provision.fog.smithi159:timed out
2024-01-23T15:53:33.426 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-23T15:53:33.701 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-23T15:53:33.702 DEBUG:teuthology.orchestra.run.smithi159:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-23T15:53:33.929 INFO:teuthology.provision.fog.smithi159:Node is ready
2024-01-23T15:53:33.930 DEBUG:teuthology.orchestra.run.smithi159:> hostname
2024-01-23T15:53:33.987 INFO:teuthology.orchestra.run.smithi159.stdout:smithi159.front.sepia.ceph.com
2024-01-23T15:53:33.988 DEBUG:teuthology.orchestra.run.smithi159:> grep smithi159.front.sepia.ceph.com /etc/hosts
2024-01-23T15:53:34.046 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159 smithi159.front.sepia.ceph.com smithi159
2024-01-23T15:53:34.046 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname smithi159
2024-01-23T15:53:34.168 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/smithi159.front.sepia.ceph.com/smithi159/g' /etc/hosts
2024-01-23T15:53:34.196 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/172.21.15.159/172.21.15.159/g' /etc/hosts
2024-01-23T15:53:34.264 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/smithi159.front.sepia.ceph.com/smithi159/g' /etc/hostname
2024-01-23T15:53:34.332 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname smithi159
2024-01-23T15:53:34.398 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release
2024-01-23T15:53:34.454 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="Red Hat Enterprise Linux"
2024-01-23T15:53:34.455 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="8.6 (Ootpa)"
2024-01-23T15:53:34.455 INFO:teuthology.orchestra.run.smithi159.stdout:ID="rhel"
2024-01-23T15:53:34.455 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="fedora"
2024-01-23T15:53:34.455 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="8.6"
2024-01-23T15:53:34.455 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el8"
2024-01-23T15:53:34.455 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-01-23T15:53:34.455 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31"
2024-01-23T15:53:34.455 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-01-23T15:53:34.455 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://www.redhat.com/"
2024-01-23T15:53:34.455 INFO:teuthology.orchestra.run.smithi159.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-01-23T15:53:34.455 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-23T15:53:34.455 INFO:teuthology.orchestra.run.smithi159.stdout:
2024-01-23T15:53:34.455 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-23T15:53:34.455 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-01-23T15:53:34.456 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-01-23T15:53:34.456 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-01-23T15:53:34.456 INFO:teuthology.provision.fog.smithi159:Deploy complete!
2024-01-23T15:53:34.457 DEBUG:teuthology.parallel:result is None
2024-01-23T15:53:34.612 INFO:teuthology.lock.ops:Checking smithi031.front.sepia.ceph.com
2024-01-23T15:53:34.612 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-23T15:53:34.631 INFO:teuthology.lock.ops:Checking smithi159.front.sepia.ceph.com
2024-01-23T15:53:34.631 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-23T15:53:34.648 INFO:teuthology.lock.ops:Updating [smithi031.front.sepia.ceph.com]: set os type and version on server
2024-01-23T15:53:34.649 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com'
2024-01-23T15:53:34.649 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-23T15:53:34.724 DEBUG:teuthology.orchestra.run.smithi031:> true
2024-01-23T15:53:34.872 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi031.front.sepia.ceph.com'
2024-01-23T15:53:34.872 DEBUG:teuthology.orchestra.run.smithi031:> uname -m
2024-01-23T15:53:34.934 INFO:teuthology.orchestra.run.smithi031.stdout:x86_64
2024-01-23T15:53:34.934 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release
2024-01-23T15:53:34.996 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="Red Hat Enterprise Linux"
2024-01-23T15:53:34.996 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="8.6 (Ootpa)"
2024-01-23T15:53:34.996 INFO:teuthology.orchestra.run.smithi031.stdout:ID="rhel"
2024-01-23T15:53:34.996 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE="fedora"
2024-01-23T15:53:34.996 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="8.6"
2024-01-23T15:53:34.996 INFO:teuthology.orchestra.run.smithi031.stdout:PLATFORM_ID="platform:el8"
2024-01-23T15:53:34.997 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-01-23T15:53:34.997 INFO:teuthology.orchestra.run.smithi031.stdout:ANSI_COLOR="0;31"
2024-01-23T15:53:34.997 INFO:teuthology.orchestra.run.smithi031.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-01-23T15:53:34.997 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://www.redhat.com/"
2024-01-23T15:53:34.997 INFO:teuthology.orchestra.run.smithi031.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-01-23T15:53:34.997 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-23T15:53:34.997 INFO:teuthology.orchestra.run.smithi031.stdout:
2024-01-23T15:53:34.997 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-23T15:53:34.997 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-01-23T15:53:34.997 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-01-23T15:53:34.997 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-01-23T15:53:34.998 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server
2024-01-23T15:53:35.023 INFO:teuthology.lock.ops:Updating [smithi159.front.sepia.ceph.com]: set os type and version on server
2024-01-23T15:53:35.023 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com'
2024-01-23T15:53:35.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-23T15:53:35.096 DEBUG:teuthology.orchestra.run.smithi159:> true
2024-01-23T15:53:35.164 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi159.front.sepia.ceph.com'
2024-01-23T15:53:35.164 DEBUG:teuthology.orchestra.run.smithi159:> uname -m
2024-01-23T15:53:35.222 INFO:teuthology.orchestra.run.smithi159.stdout:x86_64
2024-01-23T15:53:35.223 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release
2024-01-23T15:53:35.280 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="Red Hat Enterprise Linux"
2024-01-23T15:53:35.280 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="8.6 (Ootpa)"
2024-01-23T15:53:35.280 INFO:teuthology.orchestra.run.smithi159.stdout:ID="rhel"
2024-01-23T15:53:35.280 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="fedora"
2024-01-23T15:53:35.280 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="8.6"
2024-01-23T15:53:35.280 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el8"
2024-01-23T15:53:35.280 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-01-23T15:53:35.280 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31"
2024-01-23T15:53:35.280 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-01-23T15:53:35.281 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://www.redhat.com/"
2024-01-23T15:53:35.281 INFO:teuthology.orchestra.run.smithi159.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-01-23T15:53:35.281 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-23T15:53:35.281 INFO:teuthology.orchestra.run.smithi159.stdout:
2024-01-23T15:53:35.281 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-23T15:53:35.281 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-01-23T15:53:35.281 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-01-23T15:53:35.281 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-01-23T15:53:35.281 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server
2024-01-23T15:53:35.306 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-23T15:53:35.406 INFO:teuthology.dispatcher.supervisor:Running job 7528142
2024-01-23T15:53:35.406 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-01-23_14:05:57-fs-wip-vshankar-testing1-reef-2024-01-23-1317-testing-default-smithi/7528142 --name vshankar-2024-01-23_14:05:57-fs-wip-vshankar-testing1-reef-2024-01-23-1317-testing-default-smithi --description fs/32bits/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} -- /home/teuthworker/archive/vshankar-2024-01-23_14:05:57-fs-wip-vshankar-testing1-reef-2024-01-23-1317-testing-default-smithi/7528142/orig.config.yaml
2024-01-23T15:53:35.409 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-01-23_14:05:57-fs-wip-vshankar-testing1-reef-2024-01-23-1317-testing-default-smithi/7528142
2024-01-23T15:53:35.409 INFO:teuthology.dispatcher.supervisor:Job PID: 209289
2024-01-23T15:53:35.409 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-01-23T15:55:35.509 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-23T15:57:35.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-23T15:59:35.840 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-23T16:01:36.011 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-23T16:03:36.180 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-23T16:05:36.351 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-23T16:07:36.529 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-23T16:09:36.688 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-23T16:11:36.889 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-23T16:13:37.045 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-23T16:13:37.121 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2024-01-23T16:13:37.234 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2024-01-23T16:13:37.235 INFO:teuthology.nuke:Checking targets against current locks
2024-01-23T16:13:37.283 DEBUG:teuthology.nuke:shortname: smithi031
2024-01-23T16:13:37.284 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-23T16:13:37.305 DEBUG:teuthology.nuke:shortname: smithi159
2024-01-23T16:13:37.305 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-23T16:13:37.308 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi031.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-23_14:05:57-fs-wip-vshankar-testing1-reef-2024-01-23-1317-testing-default-smithi/7528142', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-23 15:48:27.834957', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAHnNbkOsHYXKf3ek+e8bEjiS2YblirNamagdtxj9GLxBndjYv04IykuLyruiauTkmMTq+Yx/kpaX125j1Ul9yA='}
2024-01-23T16:13:37.333 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi159.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-23_14:05:57-fs-wip-vshankar-testing1-reef-2024-01-23-1317-testing-default-smithi/7528142', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-23 15:48:27.836515', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDETbS08ZBqGWnhINMI/Fg2QYmUf0iTZontSwPPnEhvmerGKpXLT5n0a1MQNsamr6qk7qH6iuPSA4ufp5qfFgkk='}
2024-01-23T16:13:37.355 INFO:teuthology.orchestra.console.smithi031:Power off
2024-01-23T16:13:37.356 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-23T16:13:37.378 DEBUG:teuthology.orchestra.console.smithi031:power off output: Chassis Power Control: Down/Off
2024-01-23T16:13:37.379 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-23T16:13:37.393 INFO:teuthology.orchestra.console.smithi159:Power off
2024-01-23T16:13:37.394 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-23T16:13:37.402 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off
2024-01-23T16:13:37.415 DEBUG:teuthology.orchestra.console.smithi159:power off output: Chassis Power Control: Down/Off
2024-01-23T16:13:37.415 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-23T16:13:37.443 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off
2024-01-23T16:13:37.504 INFO:teuthology.orchestra.console.smithi031:Power off completed
2024-01-23T16:13:37.544 INFO:teuthology.orchestra.console.smithi159:Power off completed
2024-01-23T16:13:37.651 INFO:teuthology.lock.ops:unlocked: smithi031.front.sepia.ceph.com
2024-01-23T16:13:37.685 INFO:teuthology.lock.ops:unlocked: smithi159.front.sepia.ceph.com