2023-11-28T02:34:05.343 INFO:root:teuthology version: 0.0.1.dev205+g2442239
2023-11-28T02:34:05.344 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T02:34:05.492 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f5f03eff940>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f5f04a01670>, signals=[15])
2023-11-28T02:34:05.493 INFO:teuthology.lock.ops:Start node 'smithi073.front.sepia.ceph.com' reimaging
2023-11-28T02:34:05.493 INFO:teuthology.lock.ops:Updating [smithi073.front.sepia.ceph.com]: reset os type and version on server
2023-11-28T02:34:05.493 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server
2023-11-28T02:34:05.511 INFO:teuthology.lock.ops:Start node 'smithi150.front.sepia.ceph.com' reimaging
2023-11-28T02:34:05.511 INFO:teuthology.lock.ops:Updating [smithi150.front.sepia.ceph.com]: reset os type and version on server
2023-11-28T02:34:05.512 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server
2023-11-28T02:34:05.630 DEBUG:teuthology.provision.fog.smithi073:Requesting image smithi_rhel_8.4 (ID 7)
2023-11-28T02:34:05.649 DEBUG:teuthology.provision.fog.smithi150:Requesting image smithi_rhel_8.4 (ID 7)
2023-11-28T02:34:05.684 INFO:teuthology.provision.fog.smithi073:Scheduling deploy of rhel 8.4
2023-11-28T02:34:05.692 INFO:teuthology.provision.fog.smithi150:Scheduling deploy of rhel 8.4
2023-11-28T02:34:05.981 INFO:teuthology.orchestra.console.smithi073:Power off
2023-11-28T02:34:05.981 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-28T02:34:05.996 INFO:teuthology.orchestra.console.smithi150:Power off
2023-11-28T02:34:05.997 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-28T02:34:06.005 DEBUG:teuthology.orchestra.console.smithi073:power off output: Chassis Power Control: Down/Off
2023-11-28T02:34:06.005 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-28T02:34:06.021 DEBUG:teuthology.orchestra.console.smithi150:power off output: Chassis Power Control: Down/Off
2023-11-28T02:34:06.022 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-28T02:34:06.030 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is off
2023-11-28T02:34:06.043 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is on
2023-11-28T02:34:06.131 INFO:teuthology.orchestra.console.smithi073:Power off completed
2023-11-28T02:34:06.231 INFO:teuthology.orchestra.console.smithi073:Power on
2023-11-28T02:34:06.232 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-28T02:34:06.258 DEBUG:teuthology.orchestra.console.smithi073:power on output: Chassis Power Control: Up/On
2023-11-28T02:34:06.258 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-28T02:34:06.284 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is off
2023-11-28T02:34:10.047 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-28T02:34:10.157 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is on
2023-11-28T02:34:10.285 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-28T02:34:10.393 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is off
2023-11-28T02:34:14.160 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-28T02:34:14.269 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is on
2023-11-28T02:34:14.395 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-28T02:34:14.503 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on
2023-11-28T02:34:14.604 INFO:teuthology.orchestra.console.smithi073:Power on completed
2023-11-28T02:34:14.705 INFO:teuthology.provision.fog.smithi073:Waiting for deploy to finish
2023-11-28T02:34:18.273 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-28T02:34:18.383 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is off
2023-11-28T02:34:18.484 INFO:teuthology.orchestra.console.smithi150:Power off completed
2023-11-28T02:34:18.584 INFO:teuthology.orchestra.console.smithi150:Power on
2023-11-28T02:34:18.584 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-28T02:34:18.607 DEBUG:teuthology.orchestra.console.smithi150:power on output: Chassis Power Control: Up/On
2023-11-28T02:34:18.607 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-28T02:34:18.634 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is off
2023-11-28T02:34:22.638 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-28T02:34:22.747 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is off
2023-11-28T02:34:26.751 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-28T02:34:26.860 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is on
2023-11-28T02:34:26.961 INFO:teuthology.orchestra.console.smithi150:Power on completed
2023-11-28T02:34:27.061 INFO:teuthology.provision.fog.smithi150:Waiting for deploy to finish
2023-11-28T02:37:00.821 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T02:37:03.874 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73
2023-11-28T02:37:09.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T02:37:12.930 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73
2023-11-28T02:37:13.250 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T02:37:16.322 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2023-11-28T02:37:18.934 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T02:37:21.986 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73
2023-11-28T02:37:22.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T02:37:25.378 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2023-11-28T02:37:27.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T02:37:31.046 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73
2023-11-28T02:37:31.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T02:37:34.438 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2023-11-28T02:37:37.049 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T02:37:40.134 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73
2023-11-28T02:37:40.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T02:37:43.494 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2023-11-28T02:37:46.138 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T02:37:49.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T02:37:52.582 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2023-11-28T02:37:58.588 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T02:38:01.666 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2023-11-28T02:38:07.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T02:38:10.726 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2023-11-28T02:38:16.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T02:38:46.166 WARNING:teuthology.provision.fog.smithi073:timed out
2023-11-28T02:38:52.173 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T02:38:52.424 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-28T02:38:52.425 DEBUG:teuthology.orchestra.run.smithi073:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-28T02:38:52.695 INFO:teuthology.provision.fog.smithi073:Node is ready
2023-11-28T02:38:52.696 DEBUG:teuthology.orchestra.run.smithi073:> hostname
2023-11-28T02:38:52.750 INFO:teuthology.orchestra.run.smithi073.stdout:smithi073
2023-11-28T02:38:52.751 DEBUG:teuthology.orchestra.run.smithi073:> grep smithi073 /etc/hosts
2023-11-28T02:38:52.808 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73 smithi073.front.sepia.ceph.com smithi073
2023-11-28T02:38:52.808 DEBUG:teuthology.orchestra.run.smithi073:> sudo hostname smithi073
2023-11-28T02:38:52.921 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i -e 's/smithi073/smithi073/g' /etc/hosts
2023-11-28T02:38:52.945 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i -e 's/172.21.15.73/172.21.15.73/g' /etc/hosts
2023-11-28T02:38:53.012 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i -e 's/smithi073/smithi073/g' /etc/hostname
2023-11-28T02:38:53.079 DEBUG:teuthology.orchestra.run.smithi073:> sudo hostname smithi073
2023-11-28T02:38:53.145 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release
2023-11-28T02:38:53.201 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="Red Hat Enterprise Linux"
2023-11-28T02:38:53.202 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="8.4 (Ootpa)"
2023-11-28T02:38:53.202 INFO:teuthology.orchestra.run.smithi073.stdout:ID="rhel"
2023-11-28T02:38:53.202 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="fedora"
2023-11-28T02:38:53.202 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="8.4"
2023-11-28T02:38:53.202 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el8"
2023-11-28T02:38:53.202 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-11-28T02:38:53.202 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31"
2023-11-28T02:38:53.202 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-11-28T02:38:53.202 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://www.redhat.com/"
2023-11-28T02:38:53.203 INFO:teuthology.orchestra.run.smithi073.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-28T02:38:53.203 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-28T02:38:53.203 INFO:teuthology.orchestra.run.smithi073.stdout:
2023-11-28T02:38:53.203 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-28T02:38:53.203 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-11-28T02:38:53.203 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-28T02:38:53.203 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-11-28T02:38:53.204 INFO:teuthology.provision.fog.smithi073:Deploy complete!
2023-11-28T02:38:53.205 DEBUG:teuthology.parallel:result is None
2023-11-28T02:39:16.756 WARNING:teuthology.provision.fog.smithi150:timed out
2023-11-28T02:39:22.763 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T02:39:23.113 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-28T02:39:23.114 DEBUG:teuthology.orchestra.run.smithi150:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-28T02:39:23.380 INFO:teuthology.provision.fog.smithi150:Node is ready
2023-11-28T02:39:23.380 DEBUG:teuthology.orchestra.run.smithi150:> hostname
2023-11-28T02:39:23.396 INFO:teuthology.orchestra.run.smithi150.stdout:smithi150.front.sepia.ceph.com
2023-11-28T02:39:23.396 DEBUG:teuthology.orchestra.run.smithi150:> grep smithi150.front.sepia.ceph.com /etc/hosts
2023-11-28T02:39:23.450 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.15.150 smithi150.front.sepia.ceph.com smithi150
2023-11-28T02:39:23.450 DEBUG:teuthology.orchestra.run.smithi150:> sudo hostname smithi150
2023-11-28T02:39:23.555 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/smithi150.front.sepia.ceph.com/smithi150/g' /etc/hosts
2023-11-28T02:39:23.582 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/172.21.15.150/172.21.15.150/g' /etc/hosts
2023-11-28T02:39:23.647 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/smithi150.front.sepia.ceph.com/smithi150/g' /etc/hostname
2023-11-28T02:39:23.712 DEBUG:teuthology.orchestra.run.smithi150:> sudo hostname smithi150
2023-11-28T02:39:23.777 DEBUG:teuthology.orchestra.run.smithi150:> cat /etc/os-release
2023-11-28T02:39:23.832 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="Red Hat Enterprise Linux"
2023-11-28T02:39:23.832 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="8.4 (Ootpa)"
2023-11-28T02:39:23.832 INFO:teuthology.orchestra.run.smithi150.stdout:ID="rhel"
2023-11-28T02:39:23.833 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE="fedora"
2023-11-28T02:39:23.833 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="8.4"
2023-11-28T02:39:23.833 INFO:teuthology.orchestra.run.smithi150.stdout:PLATFORM_ID="platform:el8"
2023-11-28T02:39:23.833 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-11-28T02:39:23.833 INFO:teuthology.orchestra.run.smithi150.stdout:ANSI_COLOR="0;31"
2023-11-28T02:39:23.833 INFO:teuthology.orchestra.run.smithi150.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-11-28T02:39:23.833 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://www.redhat.com/"
2023-11-28T02:39:23.833 INFO:teuthology.orchestra.run.smithi150.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-28T02:39:23.833 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-28T02:39:23.833 INFO:teuthology.orchestra.run.smithi150.stdout:
2023-11-28T02:39:23.833 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-28T02:39:23.834 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-11-28T02:39:23.834 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-28T02:39:23.834 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-11-28T02:39:23.834 INFO:teuthology.provision.fog.smithi150:Deploy complete!
2023-11-28T02:39:23.835 DEBUG:teuthology.parallel:result is None
2023-11-28T02:39:23.981 INFO:teuthology.lock.ops:Checking smithi073.front.sepia.ceph.com
2023-11-28T02:39:23.981 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-28T02:39:24.011 INFO:teuthology.lock.ops:Checking smithi150.front.sepia.ceph.com
2023-11-28T02:39:24.011 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-28T02:39:24.036 INFO:teuthology.lock.ops:Updating [smithi073.front.sepia.ceph.com]: set os type and version on server
2023-11-28T02:39:24.036 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com'
2023-11-28T02:39:24.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T02:39:24.107 DEBUG:teuthology.orchestra.run.smithi073:> true
2023-11-28T02:39:24.229 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com'
2023-11-28T02:39:24.230 DEBUG:teuthology.orchestra.run.smithi073:> uname -m
2023-11-28T02:39:24.285 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64
2023-11-28T02:39:24.285 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release
2023-11-28T02:39:24.340 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="Red Hat Enterprise Linux"
2023-11-28T02:39:24.340 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="8.4 (Ootpa)"
2023-11-28T02:39:24.340 INFO:teuthology.orchestra.run.smithi073.stdout:ID="rhel"
2023-11-28T02:39:24.340 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="fedora"
2023-11-28T02:39:24.340 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="8.4"
2023-11-28T02:39:24.340 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el8"
2023-11-28T02:39:24.340 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-11-28T02:39:24.340 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31"
2023-11-28T02:39:24.340 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-11-28T02:39:24.341 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://www.redhat.com/"
2023-11-28T02:39:24.341 INFO:teuthology.orchestra.run.smithi073.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-28T02:39:24.341 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-28T02:39:24.341 INFO:teuthology.orchestra.run.smithi073.stdout:
2023-11-28T02:39:24.341 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-28T02:39:24.341 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-11-28T02:39:24.341 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-28T02:39:24.341 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-11-28T02:39:24.342 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server
2023-11-28T02:39:24.360 INFO:teuthology.lock.ops:Updating [smithi150.front.sepia.ceph.com]: set os type and version on server
2023-11-28T02:39:24.360 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com'
2023-11-28T02:39:24.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-28T02:39:24.426 DEBUG:teuthology.orchestra.run.smithi150:> true
2023-11-28T02:39:24.448 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi150.front.sepia.ceph.com'
2023-11-28T02:39:24.448 DEBUG:teuthology.orchestra.run.smithi150:> uname -m
2023-11-28T02:39:24.502 INFO:teuthology.orchestra.run.smithi150.stdout:x86_64
2023-11-28T02:39:24.503 DEBUG:teuthology.orchestra.run.smithi150:> cat /etc/os-release
2023-11-28T02:39:24.556 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="Red Hat Enterprise Linux"
2023-11-28T02:39:24.556 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="8.4 (Ootpa)"
2023-11-28T02:39:24.556 INFO:teuthology.orchestra.run.smithi150.stdout:ID="rhel"
2023-11-28T02:39:24.557 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE="fedora"
2023-11-28T02:39:24.557 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="8.4"
2023-11-28T02:39:24.557 INFO:teuthology.orchestra.run.smithi150.stdout:PLATFORM_ID="platform:el8"
2023-11-28T02:39:24.557 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-11-28T02:39:24.557 INFO:teuthology.orchestra.run.smithi150.stdout:ANSI_COLOR="0;31"
2023-11-28T02:39:24.557 INFO:teuthology.orchestra.run.smithi150.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-11-28T02:39:24.557 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://www.redhat.com/"
2023-11-28T02:39:24.557 INFO:teuthology.orchestra.run.smithi150.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-28T02:39:24.557 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-28T02:39:24.557 INFO:teuthology.orchestra.run.smithi150.stdout:
2023-11-28T02:39:24.557 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-28T02:39:24.558 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-11-28T02:39:24.558 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-28T02:39:24.558 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-11-28T02:39:24.558 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server
2023-11-28T02:39:24.577 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T02:39:24.666 INFO:teuthology.dispatcher.supervisor:Running job 7468703
2023-11-28T02:39:24.667 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-11-27_22:36:25-fs-wip-yuri-testing-2023-11-27-1028-pacific-distro-default-smithi/7468703 --name yuriw-2023-11-27_22:36:25-fs-wip-yuri-testing-2023-11-27-1028-pacific-distro-default-smithi --description fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} -- /home/teuthworker/archive/yuriw-2023-11-27_22:36:25-fs-wip-yuri-testing-2023-11-27-1028-pacific-distro-default-smithi/7468703/orig.config.yaml
2023-11-28T02:39:24.669 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-11-27_22:36:25-fs-wip-yuri-testing-2023-11-27-1028-pacific-distro-default-smithi/7468703
2023-11-28T02:39:24.670 INFO:teuthology.dispatcher.supervisor:Job PID: 3243531
2023-11-28T02:39:24.670 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-11-28T02:41:24.770 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T02:43:24.939 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T02:45:25.111 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T02:47:25.283 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T02:49:25.455 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T02:51:25.619 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T02:53:25.791 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T02:55:25.959 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T02:57:26.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T02:59:26.297 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T03:01:26.455 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T03:03:26.622 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T03:05:26.806 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T03:07:26.971 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T03:09:27.139 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T03:11:27.325 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T03:13:27.488 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T03:15:27.654 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T03:17:27.811 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T03:19:27.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T03:21:28.183 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T03:23:28.354 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T03:25:28.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T03:27:28.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T03:29:28.855 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T03:31:29.023 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T03:33:29.195 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T03:35:29.363 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T03:37:29.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T03:39:29.688 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T03:41:29.863 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T03:43:31.024 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T03:45:31.189 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T03:47:31.354 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T03:49:31.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T03:51:31.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T03:53:31.855 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T03:55:32.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T03:57:32.196 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T03:59:32.361 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T04:01:32.531 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T04:03:32.694 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T04:05:32.871 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T04:07:33.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T04:09:34.062 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T04:11:34.242 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T04:13:34.406 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T04:15:34.583 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T04:17:34.768 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T04:19:34.935 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T04:21:35.103 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T04:23:35.274 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T04:25:35.442 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T04:27:37.995 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-28T04:27:42.691 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-11-28T04:27:42.867 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-11-28T04:27:42.869 INFO:teuthology.nuke:Checking targets against current locks
2023-11-28T04:27:42.915 DEBUG:teuthology.nuke:shortname: smithi073
2023-11-28T04:27:42.916 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-28T04:27:42.938 DEBUG:teuthology.nuke:shortname: smithi150
2023-11-28T04:27:42.939 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-28T04:27:42.942 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi073.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-27_22:36:25-fs-wip-yuri-testing-2023-11-27-1028-pacific-distro-default-smithi/7468703', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 02:34:04.405562', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLrYwp82qOkNzBtVWZdiiw7/4vzuuaQgmcQg21uwlcmpDvvwZwnShDLiOf7e7CBPwpQcWBLI4+9CevKpbl/G7vQ='}
2023-11-28T04:27:42.964 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi150.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-27_22:36:25-fs-wip-yuri-testing-2023-11-27-1028-pacific-distro-default-smithi/7468703', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 02:34:04.406976', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOcsXlOEX6iheXxSe0SiQYyxcdk15GcmPxRXO6f5afn5qNlnTo44BVJqyXGhrJt5x77Pw+PUYTWTkbOBwmE5x6A='}
2023-11-28T04:27:42.988 INFO:teuthology.orchestra.console.smithi073:Power off
2023-11-28T04:27:42.988 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-28T04:27:43.012 DEBUG:teuthology.orchestra.console.smithi073:power off output: Chassis Power Control: Down/Off
2023-11-28T04:27:43.012 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-28T04:27:43.025 INFO:teuthology.orchestra.console.smithi150:Power off
2023-11-28T04:27:43.026 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-28T04:27:43.037 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is off
2023-11-28T04:27:43.050 DEBUG:teuthology.orchestra.console.smithi150:power off output: Chassis Power Control: Down/Off
2023-11-28T04:27:43.050 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-28T04:27:43.076 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is off
2023-11-28T04:27:43.138 INFO:teuthology.orchestra.console.smithi073:Power off completed
2023-11-28T04:27:43.177 INFO:teuthology.orchestra.console.smithi150:Power off completed
2023-11-28T04:27:43.291 INFO:teuthology.lock.ops:unlocked: smithi073.front.sepia.ceph.com
2023-11-28T04:27:43.333 INFO:teuthology.lock.ops:unlocked: smithi150.front.sepia.ceph.com