2024-01-21T20:25:14.478 INFO:root:teuthology version: 0.0.1.dev249+gcd45576
2024-01-21T20:25:14.479 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-21T20:25:14.630 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f1565f96f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f1566efdc10>, signals=[15])
2024-01-21T20:25:14.631 INFO:teuthology.lock.ops:Start node 'smithi093.front.sepia.ceph.com' reimaging
2024-01-21T20:25:14.631 INFO:teuthology.lock.ops:Updating [smithi093.front.sepia.ceph.com]: reset os type and version on server
2024-01-21T20:25:14.631 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server
2024-01-21T20:25:14.650 INFO:teuthology.lock.ops:Start node 'smithi141.front.sepia.ceph.com' reimaging
2024-01-21T20:25:14.650 INFO:teuthology.lock.ops:Updating [smithi141.front.sepia.ceph.com]: reset os type and version on server
2024-01-21T20:25:14.650 INFO:teuthology.lock.ops:Updating smithi141.front.sepia.ceph.com on lock server
2024-01-21T20:25:14.767 DEBUG:teuthology.provision.fog.smithi093:Requesting image smithi_rhel_8.6 (ID 5)
2024-01-21T20:25:14.792 DEBUG:teuthology.provision.fog.smithi141:Requesting image smithi_rhel_8.6 (ID 5)
2024-01-21T20:25:14.823 INFO:teuthology.provision.fog.smithi093:Scheduling deploy of rhel 8.6
2024-01-21T20:25:14.841 INFO:teuthology.provision.fog.smithi141:Scheduling deploy of rhel 8.6
2024-01-21T20:25:15.054 INFO:teuthology.orchestra.console.smithi093:Power off
2024-01-21T20:25:15.054 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-21T20:25:15.067 INFO:teuthology.orchestra.console.smithi141:Power off
2024-01-21T20:25:15.068 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-21T20:25:15.077 DEBUG:teuthology.orchestra.console.smithi093:power off output: Chassis Power Control: Down/Off
2024-01-21T20:25:15.077 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-21T20:25:15.093 DEBUG:teuthology.orchestra.console.smithi141:power off output: Chassis Power Control: Down/Off
2024-01-21T20:25:15.094 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-21T20:25:15.102 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off
2024-01-21T20:25:15.116 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is on
2024-01-21T20:25:15.203 INFO:teuthology.orchestra.console.smithi093:Power off completed
2024-01-21T20:25:15.304 INFO:teuthology.orchestra.console.smithi093:Power on
2024-01-21T20:25:15.304 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-21T20:25:15.324 DEBUG:teuthology.orchestra.console.smithi093:power on output: Chassis Power Control: Up/On
2024-01-21T20:25:15.325 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-21T20:25:15.344 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off
2024-01-21T20:25:19.120 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-21T20:25:19.229 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is on
2024-01-21T20:25:19.345 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-21T20:25:19.454 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is on
2024-01-21T20:25:19.554 INFO:teuthology.orchestra.console.smithi093:Power on completed
2024-01-21T20:25:19.655 INFO:teuthology.provision.fog.smithi093:Waiting for deploy to finish
2024-01-21T20:25:23.232 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-21T20:25:23.340 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is on
2024-01-21T20:25:27.344 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-21T20:25:27.453 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is off
2024-01-21T20:25:27.554 INFO:teuthology.orchestra.console.smithi141:Power off completed
2024-01-21T20:25:27.654 INFO:teuthology.orchestra.console.smithi141:Power on
2024-01-21T20:25:27.654 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-21T20:25:27.674 DEBUG:teuthology.orchestra.console.smithi141:power on output: Chassis Power Control: Up/On
2024-01-21T20:25:27.675 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-21T20:25:27.697 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is off
2024-01-21T20:25:31.698 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-21T20:25:31.806 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is off
2024-01-21T20:25:35.808 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-21T20:25:35.916 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is on
2024-01-21T20:25:36.016 INFO:teuthology.orchestra.console.smithi141:Power on completed
2024-01-21T20:25:36.117 INFO:teuthology.provision.fog.smithi141:Waiting for deploy to finish
2024-01-21T20:29:15.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-21T20:29:34.140 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93
2024-01-21T20:29:40.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-21T20:29:43.228 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93
2024-01-21T20:29:49.230 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-21T20:29:52.284 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93
2024-01-21T20:29:58.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-21T20:30:01.340 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93
2024-01-21T20:30:07.341 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-21T20:31:07.349 WARNING:teuthology.provision.fog.smithi093:timed out
2024-01-21T20:31:13.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-21T20:31:13.661 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-21T20:31:13.661 DEBUG:teuthology.orchestra.run.smithi093:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-21T20:31:13.940 INFO:teuthology.provision.fog.smithi093:Node is ready
2024-01-21T20:31:13.940 DEBUG:teuthology.orchestra.run.smithi093:> hostname
2024-01-21T20:31:13.959 INFO:teuthology.orchestra.run.smithi093.stdout:smithi093
2024-01-21T20:31:13.960 DEBUG:teuthology.orchestra.run.smithi093:> grep smithi093 /etc/hosts
2024-01-21T20:31:14.020 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93 smithi093.front.sepia.ceph.com smithi093
2024-01-21T20:31:14.020 DEBUG:teuthology.orchestra.run.smithi093:> sudo hostname smithi093
2024-01-21T20:31:14.135 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/smithi093/smithi093/g' /etc/hosts
2024-01-21T20:31:14.166 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/172.21.15.93/172.21.15.93/g' /etc/hosts
2024-01-21T20:31:14.235 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/smithi093/smithi093/g' /etc/hostname
2024-01-21T20:31:14.304 DEBUG:teuthology.orchestra.run.smithi093:> sudo hostname smithi093
2024-01-21T20:31:14.372 DEBUG:teuthology.orchestra.run.smithi093:> cat /etc/os-release
2024-01-21T20:31:14.430 INFO:teuthology.orchestra.run.smithi093.stdout:NAME="Red Hat Enterprise Linux"
2024-01-21T20:31:14.430 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION="8.6 (Ootpa)"
2024-01-21T20:31:14.430 INFO:teuthology.orchestra.run.smithi093.stdout:ID="rhel"
2024-01-21T20:31:14.430 INFO:teuthology.orchestra.run.smithi093.stdout:ID_LIKE="fedora"
2024-01-21T20:31:14.430 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_ID="8.6"
2024-01-21T20:31:14.430 INFO:teuthology.orchestra.run.smithi093.stdout:PLATFORM_ID="platform:el8"
2024-01-21T20:31:14.430 INFO:teuthology.orchestra.run.smithi093.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-01-21T20:31:14.430 INFO:teuthology.orchestra.run.smithi093.stdout:ANSI_COLOR="0;31"
2024-01-21T20:31:14.430 INFO:teuthology.orchestra.run.smithi093.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-01-21T20:31:14.430 INFO:teuthology.orchestra.run.smithi093.stdout:HOME_URL="https://www.redhat.com/"
2024-01-21T20:31:14.431 INFO:teuthology.orchestra.run.smithi093.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-01-21T20:31:14.431 INFO:teuthology.orchestra.run.smithi093.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-21T20:31:14.431 INFO:teuthology.orchestra.run.smithi093.stdout:
2024-01-21T20:31:14.431 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-21T20:31:14.431 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-01-21T20:31:14.431 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-01-21T20:31:14.431 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-01-21T20:31:14.432 INFO:teuthology.provision.fog.smithi093:Deploy complete!
2024-01-21T20:31:14.433 DEBUG:teuthology.parallel:result is None
2024-01-21T20:32:39.148 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-21T20:32:42.204 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141
2024-01-21T20:32:48.211 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-21T20:32:51.292 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141
2024-01-21T20:32:57.299 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-21T20:33:00.380 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141
2024-01-21T20:33:06.387 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-21T20:33:09.468 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141
2024-01-21T20:33:15.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-21T20:33:18.524 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141
2024-01-21T20:33:24.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-21T20:33:27.584 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141
2024-01-21T20:33:33.588 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-21T20:34:33.650 WARNING:teuthology.provision.fog.smithi141:timed out
2024-01-21T20:34:39.655 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-21T20:34:39.962 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-21T20:34:39.962 DEBUG:teuthology.orchestra.run.smithi141:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-21T20:34:40.239 INFO:teuthology.provision.fog.smithi141:Node is ready
2024-01-21T20:34:40.239 DEBUG:teuthology.orchestra.run.smithi141:> hostname
2024-01-21T20:34:40.256 INFO:teuthology.orchestra.run.smithi141.stdout:smithi141
2024-01-21T20:34:40.257 DEBUG:teuthology.orchestra.run.smithi141:> grep smithi141 /etc/hosts
2024-01-21T20:34:40.314 INFO:teuthology.orchestra.run.smithi141.stdout:172.21.15.141 smithi141.front.sepia.ceph.com smithi141
2024-01-21T20:34:40.315 DEBUG:teuthology.orchestra.run.smithi141:> sudo hostname smithi141
2024-01-21T20:34:40.414 DEBUG:teuthology.orchestra.run.smithi141:> sudo sed -i -e 's/smithi141/smithi141/g' /etc/hosts
2024-01-21T20:34:40.442 DEBUG:teuthology.orchestra.run.smithi141:> sudo sed -i -e 's/172.21.15.141/172.21.15.141/g' /etc/hosts
2024-01-21T20:34:40.511 DEBUG:teuthology.orchestra.run.smithi141:> sudo sed -i -e 's/smithi141/smithi141/g' /etc/hostname
2024-01-21T20:34:40.578 DEBUG:teuthology.orchestra.run.smithi141:> sudo hostname smithi141
2024-01-21T20:34:40.644 DEBUG:teuthology.orchestra.run.smithi141:> cat /etc/os-release
2024-01-21T20:34:40.701 INFO:teuthology.orchestra.run.smithi141.stdout:NAME="Red Hat Enterprise Linux"
2024-01-21T20:34:40.701 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION="8.6 (Ootpa)"
2024-01-21T20:34:40.701 INFO:teuthology.orchestra.run.smithi141.stdout:ID="rhel"
2024-01-21T20:34:40.701 INFO:teuthology.orchestra.run.smithi141.stdout:ID_LIKE="fedora"
2024-01-21T20:34:40.701 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION_ID="8.6"
2024-01-21T20:34:40.701 INFO:teuthology.orchestra.run.smithi141.stdout:PLATFORM_ID="platform:el8"
2024-01-21T20:34:40.701 INFO:teuthology.orchestra.run.smithi141.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-01-21T20:34:40.701 INFO:teuthology.orchestra.run.smithi141.stdout:ANSI_COLOR="0;31"
2024-01-21T20:34:40.702 INFO:teuthology.orchestra.run.smithi141.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-01-21T20:34:40.702 INFO:teuthology.orchestra.run.smithi141.stdout:HOME_URL="https://www.redhat.com/"
2024-01-21T20:34:40.702 INFO:teuthology.orchestra.run.smithi141.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-01-21T20:34:40.702 INFO:teuthology.orchestra.run.smithi141.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-21T20:34:40.702 INFO:teuthology.orchestra.run.smithi141.stdout:
2024-01-21T20:34:40.702 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-21T20:34:40.702 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-01-21T20:34:40.702 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-01-21T20:34:40.702 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-01-21T20:34:40.702 INFO:teuthology.provision.fog.smithi141:Deploy complete!
2024-01-21T20:34:40.703 DEBUG:teuthology.parallel:result is None
2024-01-21T20:34:40.852 INFO:teuthology.lock.ops:Checking smithi093.front.sepia.ceph.com
2024-01-21T20:34:40.852 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-21T20:34:40.877 INFO:teuthology.lock.ops:Checking smithi141.front.sepia.ceph.com
2024-01-21T20:34:40.877 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-21T20:34:40.903 INFO:teuthology.lock.ops:Updating [smithi093.front.sepia.ceph.com]: set os type and version on server
2024-01-21T20:34:40.903 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com'
2024-01-21T20:34:40.904 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-21T20:34:40.976 DEBUG:teuthology.orchestra.run.smithi093:> true
2024-01-21T20:34:41.114 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi093.front.sepia.ceph.com'
2024-01-21T20:34:41.114 DEBUG:teuthology.orchestra.run.smithi093:> uname -m
2024-01-21T20:34:41.171 INFO:teuthology.orchestra.run.smithi093.stdout:x86_64
2024-01-21T20:34:41.171 DEBUG:teuthology.orchestra.run.smithi093:> cat /etc/os-release
2024-01-21T20:34:41.228 INFO:teuthology.orchestra.run.smithi093.stdout:NAME="Red Hat Enterprise Linux"
2024-01-21T20:34:41.228 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION="8.6 (Ootpa)"
2024-01-21T20:34:41.228 INFO:teuthology.orchestra.run.smithi093.stdout:ID="rhel"
2024-01-21T20:34:41.228 INFO:teuthology.orchestra.run.smithi093.stdout:ID_LIKE="fedora"
2024-01-21T20:34:41.228 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_ID="8.6"
2024-01-21T20:34:41.228 INFO:teuthology.orchestra.run.smithi093.stdout:PLATFORM_ID="platform:el8"
2024-01-21T20:34:41.228 INFO:teuthology.orchestra.run.smithi093.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-01-21T20:34:41.229 INFO:teuthology.orchestra.run.smithi093.stdout:ANSI_COLOR="0;31"
2024-01-21T20:34:41.229 INFO:teuthology.orchestra.run.smithi093.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-01-21T20:34:41.229 INFO:teuthology.orchestra.run.smithi093.stdout:HOME_URL="https://www.redhat.com/"
2024-01-21T20:34:41.229 INFO:teuthology.orchestra.run.smithi093.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-01-21T20:34:41.229 INFO:teuthology.orchestra.run.smithi093.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-21T20:34:41.229 INFO:teuthology.orchestra.run.smithi093.stdout:
2024-01-21T20:34:41.229 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-21T20:34:41.229 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-01-21T20:34:41.229 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-01-21T20:34:41.229 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-01-21T20:34:41.230 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server
2024-01-21T20:34:41.252 INFO:teuthology.lock.ops:Updating [smithi141.front.sepia.ceph.com]: set os type and version on server
2024-01-21T20:34:41.252 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com'
2024-01-21T20:34:41.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-21T20:34:41.322 DEBUG:teuthology.orchestra.run.smithi141:> true
2024-01-21T20:34:41.389 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi141.front.sepia.ceph.com'
2024-01-21T20:34:41.390 DEBUG:teuthology.orchestra.run.smithi141:> uname -m
2024-01-21T20:34:41.447 INFO:teuthology.orchestra.run.smithi141.stdout:x86_64
2024-01-21T20:34:41.448 DEBUG:teuthology.orchestra.run.smithi141:> cat /etc/os-release
2024-01-21T20:34:41.505 INFO:teuthology.orchestra.run.smithi141.stdout:NAME="Red Hat Enterprise Linux"
2024-01-21T20:34:41.505 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION="8.6 (Ootpa)"
2024-01-21T20:34:41.505 INFO:teuthology.orchestra.run.smithi141.stdout:ID="rhel"
2024-01-21T20:34:41.505 INFO:teuthology.orchestra.run.smithi141.stdout:ID_LIKE="fedora"
2024-01-21T20:34:41.506 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION_ID="8.6"
2024-01-21T20:34:41.506 INFO:teuthology.orchestra.run.smithi141.stdout:PLATFORM_ID="platform:el8"
2024-01-21T20:34:41.506 INFO:teuthology.orchestra.run.smithi141.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-01-21T20:34:41.506 INFO:teuthology.orchestra.run.smithi141.stdout:ANSI_COLOR="0;31"
2024-01-21T20:34:41.506 INFO:teuthology.orchestra.run.smithi141.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-01-21T20:34:41.506 INFO:teuthology.orchestra.run.smithi141.stdout:HOME_URL="https://www.redhat.com/"
2024-01-21T20:34:41.506 INFO:teuthology.orchestra.run.smithi141.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-01-21T20:34:41.506 INFO:teuthology.orchestra.run.smithi141.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-21T20:34:41.506 INFO:teuthology.orchestra.run.smithi141.stdout:
2024-01-21T20:34:41.506 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-21T20:34:41.506 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-01-21T20:34:41.506 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-01-21T20:34:41.506 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-01-21T20:34:41.507 INFO:teuthology.lock.ops:Updating smithi141.front.sepia.ceph.com on lock server
2024-01-21T20:34:41.536 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-21T20:34:41.637 INFO:teuthology.dispatcher.supervisor:Running job 7521871
2024-01-21T20:34:41.637 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-01-19_10:13:34-fs-wip-vshankar-testing-20240119.075157-testing-default-smithi/7521871 --name vshankar-2024-01-19_10:13:34-fs-wip-vshankar-testing-20240119.075157-testing-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/iozone}} -- /home/teuthworker/archive/vshankar-2024-01-19_10:13:34-fs-wip-vshankar-testing-20240119.075157-testing-default-smithi/7521871/orig.config.yaml
2024-01-21T20:34:41.640 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-01-19_10:13:34-fs-wip-vshankar-testing-20240119.075157-testing-default-smithi/7521871
2024-01-21T20:34:41.640 INFO:teuthology.dispatcher.supervisor:Job PID: 878981
2024-01-21T20:34:41.640 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-01-21T20:36:41.741 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-21T20:38:41.915 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-21T20:40:42.088 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-21T20:42:42.252 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-21T20:44:42.428 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-21T20:46:42.600 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-21T20:46:42.667 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2024-01-21T20:46:42.811 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2024-01-21T20:46:42.811 INFO:teuthology.nuke:Checking targets against current locks
2024-01-21T20:46:42.860 DEBUG:teuthology.nuke:shortname: smithi093
2024-01-21T20:46:42.861 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-21T20:46:42.884 DEBUG:teuthology.nuke:shortname: smithi141
2024-01-21T20:46:42.884 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-21T20:46:42.888 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi093.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-19_10:13:34-fs-wip-vshankar-testing-20240119.075157-testing-default-smithi/7521871', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-21 20:25:13.497685', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIhXGgoJaWT3X1Alo9xmcs4o5M2J66oNZZLJCPqdvWTRHrU/0N2vOEEud4aBpRcrHW8O5zYQ45g1VzY7R1dBbUY='}
2024-01-21T20:46:42.914 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi141.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-19_10:13:34-fs-wip-vshankar-testing-20240119.075157-testing-default-smithi/7521871', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-21 20:25:13.496319', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGKTQlvgo5gzHhVNZXNwTLanKWbQomJ4XN61xbdt2GFn0GntljHR5tlvgH1Xv4AF8PX/l3jz8A8l4IdecX4XJpM='}
2024-01-21T20:46:42.936 INFO:teuthology.orchestra.console.smithi093:Power off
2024-01-21T20:46:42.936 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-21T20:46:42.960 DEBUG:teuthology.orchestra.console.smithi093:power off output: Chassis Power Control: Down/Off
2024-01-21T20:46:42.961 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-21T20:46:42.980 INFO:teuthology.orchestra.console.smithi141:Power off
2024-01-21T20:46:42.980 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-21T20:46:42.991 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off
2024-01-21T20:46:43.006 DEBUG:teuthology.orchestra.console.smithi141:power off output: Chassis Power Control: Down/Off
2024-01-21T20:46:43.006 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-21T20:46:43.031 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is off
2024-01-21T20:46:43.092 INFO:teuthology.orchestra.console.smithi093:Power off completed
2024-01-21T20:46:43.132 INFO:teuthology.orchestra.console.smithi141:Power off completed
2024-01-21T20:46:43.240 INFO:teuthology.lock.ops:unlocked: smithi093.front.sepia.ceph.com
2024-01-21T20:46:43.282 INFO:teuthology.lock.ops:unlocked: smithi141.front.sepia.ceph.com