2023-07-24T05:04:08.132 INFO:root:teuthology version: 0.0.1.dev158+g1426592 2023-07-24T05:04:08.134 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-24T05:04:08.134 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-24T05:04:08.277 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fbc4d4e73a0>, signals=[15]) 2023-07-24T05:04:08.279 INFO:teuthology.lock.ops:Start node 'smithi032.front.sepia.ceph.com' reimaging 2023-07-24T05:04:08.279 INFO:teuthology.lock.ops:Updating [smithi032.front.sepia.ceph.com]: reset os type and version on server 2023-07-24T05:04:08.279 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server 2023-07-24T05:04:08.300 INFO:teuthology.lock.ops:Start node 'smithi194.front.sepia.ceph.com' reimaging 2023-07-24T05:04:08.301 INFO:teuthology.lock.ops:Updating [smithi194.front.sepia.ceph.com]: reset os type and version on server 2023-07-24T05:04:08.301 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2023-07-24T05:04:08.302 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /host {"name": "smithi032"} 2023-07-24T05:04:08.325 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /host {"name": "smithi194"} 2023-07-24T05:04:08.370 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-24T05:04:08.393 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-24T05:04:08.407 DEBUG:teuthology.provision.fog.smithi032:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-24T05:04:08.407 DEBUG:teuthology.provision.fog.smithi032:FOG request: PUT /host/137 {"imageID": 5} 2023-07-24T05:04:08.444 DEBUG:teuthology.provision.fog.smithi194:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-24T05:04:08.444 DEBUG:teuthology.provision.fog.smithi194:FOG request: PUT /host/299 {"imageID": 5} 2023-07-24T05:04:08.449 INFO:teuthology.provision.fog.smithi032:Scheduling deploy of rhel 8.6 2023-07-24T05:04:08.449 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-07-24T05:04:08.500 INFO:teuthology.provision.fog.smithi194:Scheduling deploy of rhel 8.6 2023-07-24T05:04:08.500 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-24T05:04:08.643 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /tasktype {"name": "deploy"} 2023-07-24T05:04:08.678 DEBUG:teuthology.provision.fog.smithi032:FOG request: POST /host/137/task {"taskTypeID": 1} 2023-07-24T05:04:08.688 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /tasktype {"name": "deploy"} 2023-07-24T05:04:08.730 DEBUG:teuthology.provision.fog.smithi194:FOG request: POST /host/299/task {"taskTypeID": 1} 2023-07-24T05:04:08.732 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-07-24T05:04:08.778 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-24T05:04:08.998 INFO:teuthology.orchestra.console:Power off smithi032 2023-07-24T05:04:09.000 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-24T05:04:09.022 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-24T05:04:09.023 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T05:04:09.046 INFO:teuthology.orchestra.console:Power off smithi194 2023-07-24T05:04:09.047 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-24T05:04:09.056 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-24T05:04:09.067 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-24T05:04:09.067 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T05:04:09.088 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-24T05:04:13.060 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T05:04:13.089 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T05:04:13.169 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-24T05:04:13.199 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-24T05:04:17.172 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T05:04:17.201 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T05:04:17.282 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-24T05:04:17.310 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-24T05:04:17.384 INFO:teuthology.orchestra.console:Power off for smithi032 completed 2023-07-24T05:04:17.411 INFO:teuthology.orchestra.console:Power off for smithi194 completed 2023-07-24T05:04:17.485 INFO:teuthology.orchestra.console:Power on smithi032 2023-07-24T05:04:17.485 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-24T05:04:17.506 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On 2023-07-24T05:04:17.506 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T05:04:17.514 INFO:teuthology.orchestra.console:Power on smithi194 2023-07-24T05:04:17.515 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-24T05:04:17.527 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-24T05:04:17.534 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On 2023-07-24T05:04:17.535 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T05:04:17.556 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-24T05:04:21.528 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T05:04:21.558 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T05:04:21.638 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-24T05:04:21.667 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-24T05:04:25.643 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T05:04:25.668 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T05:04:25.753 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-24T05:04:25.776 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-24T05:04:25.855 INFO:teuthology.orchestra.console:Power on for smithi032 completed 2023-07-24T05:04:25.878 INFO:teuthology.orchestra.console:Power on for smithi194 completed 2023-07-24T05:04:25.956 INFO:teuthology.provision.fog.smithi032:Waiting for deploy to finish 2023-07-24T05:04:25.957 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-07-24T05:04:25.979 INFO:teuthology.provision.fog.smithi194:Waiting for deploy to finish 2023-07-24T05:04:25.979 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-24T05:04:41.258 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-24T05:04:41.260 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-07-24T05:04:56.515 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-24T05:04:56.516 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-07-24T05:05:11.773 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-24T05:05:11.775 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-07-24T05:05:27.116 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-07-24T05:05:27.124 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-24T05:05:42.452 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-24T05:05:42.454 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-07-24T05:05:57.779 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-07-24T05:05:57.780 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-24T05:06:20.719 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-24T05:06:20.721 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-07-24T05:06:38.545 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-24T05:06:38.546 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-07-24T05:06:55.880 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-07-24T05:06:56.190 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-24T05:07:11.304 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-07-24T05:07:11.577 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-24T05:07:27.900 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-07-24T05:07:27.901 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-24T05:07:47.427 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-07-24T05:07:47.568 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-24T05:08:04.539 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-24T05:08:04.552 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-07-24T05:08:21.352 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-24T05:08:21.354 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-07-24T05:08:38.695 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-07-24T05:08:38.862 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-24T05:08:55.282 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-07-24T05:08:55.420 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-24T05:09:11.881 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-07-24T05:09:12.202 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-24T05:09:28.182 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-07-24T05:09:28.616 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-24T05:09:44.402 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-07-24T05:09:44.851 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-24T05:09:59.748 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-07-24T05:10:00.571 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-24T05:10:15.128 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-07-24T05:10:16.232 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-24T05:10:30.508 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-07-24T05:10:31.986 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-24T05:10:45.900 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-07-24T05:10:47.608 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-24T05:11:01.272 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-07-24T05:11:03.046 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-24T05:11:16.649 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-07-24T05:11:18.718 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-24T05:11:32.004 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-07-24T05:11:34.128 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-24T05:11:47.298 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-07-24T05:11:49.496 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-24T05:12:02.616 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-07-24T05:12:04.687 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-24T05:12:17.908 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-07-24T05:12:20.040 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-24T05:12:33.192 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-07-24T05:12:35.367 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-24T05:12:48.504 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None 2023-07-24T05:12:48.733 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:12:50.671 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-24T05:12:51.792 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2023-07-24T05:12:57.796 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:13:00.848 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2023-07-24T05:13:06.024 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-24T05:13:06.850 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:13:09.904 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2023-07-24T05:13:15.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:13:18.964 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2023-07-24T05:13:21.336 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-24T05:13:24.968 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:13:28.048 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2023-07-24T05:13:34.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:13:36.695 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-24T05:13:52.009 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-24T05:14:07.276 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-24T05:14:22.559 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-24T05:14:34.064 WARNING:teuthology.provision.fog.smithi032:timed out 2023-07-24T05:14:37.804 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-24T05:14:40.068 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:14:40.320 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-24T05:14:40.321 DEBUG:teuthology.orchestra.run.smithi032:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-24T05:14:40.626 INFO:teuthology.provision.fog.smithi032:Node is ready 2023-07-24T05:14:40.627 DEBUG:teuthology.orchestra.run.smithi032:> hostname 2023-07-24T05:14:40.646 INFO:teuthology.orchestra.run.smithi032.stdout:smithi032.front.sepia.ceph.com 2023-07-24T05:14:40.647 DEBUG:teuthology.orchestra.run.smithi032:> grep smithi032.front.sepia.ceph.com /etc/hosts 2023-07-24T05:14:40.705 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32 smithi032.front.sepia.ceph.com smithi032 2023-07-24T05:14:40.706 DEBUG:teuthology.orchestra.run.smithi032:> sudo hostname smithi032 2023-07-24T05:14:40.812 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/smithi032.front.sepia.ceph.com/smithi032/g' /etc/hosts 2023-07-24T05:14:40.842 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/172.21.15.32/172.21.15.32/g' /etc/hosts 2023-07-24T05:14:40.911 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/smithi032.front.sepia.ceph.com/smithi032/g' /etc/hostname 2023-07-24T05:14:40.981 DEBUG:teuthology.orchestra.run.smithi032:> sudo hostname smithi032 2023-07-24T05:14:41.049 DEBUG:teuthology.orchestra.run.smithi032:> cat /etc/os-release 2023-07-24T05:14:41.107 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="Red Hat Enterprise Linux" 2023-07-24T05:14:41.107 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="8.6 (Ootpa)" 2023-07-24T05:14:41.107 INFO:teuthology.orchestra.run.smithi032.stdout:ID="rhel" 2023-07-24T05:14:41.107 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE="fedora" 2023-07-24T05:14:41.108 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="8.6" 2023-07-24T05:14:41.108 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM_ID="platform:el8" 2023-07-24T05:14:41.108 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-24T05:14:41.108 INFO:teuthology.orchestra.run.smithi032.stdout:ANSI_COLOR="0;31" 2023-07-24T05:14:41.108 INFO:teuthology.orchestra.run.smithi032.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-24T05:14:41.108 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://www.redhat.com/" 2023-07-24T05:14:41.108 INFO:teuthology.orchestra.run.smithi032.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-24T05:14:41.109 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-24T05:14:41.109 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-07-24T05:14:41.109 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-24T05:14:41.109 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-24T05:14:41.109 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-24T05:14:41.109 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-24T05:14:41.110 INFO:teuthology.provision.fog.smithi032:Deploy complete! 2023-07-24T05:14:41.111 DEBUG:teuthology.parallel:result is None 2023-07-24T05:14:53.069 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-24T05:15:08.320 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-24T05:15:23.516 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-24T05:15:38.725 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-24T05:15:53.908 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-24T05:16:09.079 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-24T05:16:24.264 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-24T05:16:39.428 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-24T05:16:54.584 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-24T05:17:09.736 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-24T05:17:24.896 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-24T05:17:40.064 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-24T05:17:55.221 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-24T05:18:10.356 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-24T05:18:25.479 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-24T05:18:40.624 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-24T05:18:55.752 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-07-24T05:18:55.870 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:18:58.932 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-07-24T05:19:04.936 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:19:08.020 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-07-24T05:19:14.026 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:19:17.104 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-07-24T05:19:23.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:19:26.160 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-07-24T05:19:32.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:19:35.216 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-07-24T05:19:41.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:20:41.280 WARNING:teuthology.provision.fog.smithi194:timed out 2023-07-24T05:20:47.284 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:20:47.820 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-24T05:20:47.821 DEBUG:teuthology.orchestra.run.smithi194:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-24T05:20:48.085 INFO:teuthology.provision.fog.smithi194:Node is ready 2023-07-24T05:20:48.085 DEBUG:teuthology.orchestra.run.smithi194:> hostname 2023-07-24T05:20:48.102 INFO:teuthology.orchestra.run.smithi194.stdout:smithi194 2023-07-24T05:20:48.103 DEBUG:teuthology.orchestra.run.smithi194:> grep smithi194 /etc/hosts 2023-07-24T05:20:48.161 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.15.194 smithi194.front.sepia.ceph.com smithi194 2023-07-24T05:20:48.161 DEBUG:teuthology.orchestra.run.smithi194:> sudo hostname smithi194 2023-07-24T05:20:48.276 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/smithi194/smithi194/g' /etc/hosts 2023-07-24T05:20:48.304 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/172.21.15.194/172.21.15.194/g' /etc/hosts 2023-07-24T05:20:48.373 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/smithi194/smithi194/g' /etc/hostname 2023-07-24T05:20:48.442 DEBUG:teuthology.orchestra.run.smithi194:> sudo hostname smithi194 2023-07-24T05:20:48.510 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release 2023-07-24T05:20:48.567 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="Red Hat Enterprise Linux" 2023-07-24T05:20:48.568 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="8.6 (Ootpa)" 2023-07-24T05:20:48.568 INFO:teuthology.orchestra.run.smithi194.stdout:ID="rhel" 2023-07-24T05:20:48.568 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="fedora" 2023-07-24T05:20:48.568 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="8.6" 2023-07-24T05:20:48.568 INFO:teuthology.orchestra.run.smithi194.stdout:PLATFORM_ID="platform:el8" 2023-07-24T05:20:48.569 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-24T05:20:48.569 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31" 2023-07-24T05:20:48.569 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-24T05:20:48.569 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://www.redhat.com/" 2023-07-24T05:20:48.569 INFO:teuthology.orchestra.run.smithi194.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-24T05:20:48.569 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-24T05:20:48.569 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-07-24T05:20:48.570 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-24T05:20:48.570 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-24T05:20:48.570 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-24T05:20:48.570 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-24T05:20:48.570 INFO:teuthology.provision.fog.smithi194:Deploy complete! 2023-07-24T05:20:48.571 DEBUG:teuthology.parallel:result is None 2023-07-24T05:20:48.727 INFO:teuthology.lock.ops:Checking smithi032.front.sepia.ceph.com 2023-07-24T05:20:48.727 INFO:teuthology.lock.ops:Checking smithi194.front.sepia.ceph.com 2023-07-24T05:20:48.728 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-24T05:20:48.754 INFO:teuthology.lock.ops:Updating [smithi032.front.sepia.ceph.com]: set os type and version on server 2023-07-24T05:20:48.754 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2023-07-24T05:20:48.755 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:20:48.828 DEBUG:teuthology.orchestra.run.smithi032:> true 2023-07-24T05:20:48.968 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi032.front.sepia.ceph.com' 2023-07-24T05:20:48.969 DEBUG:teuthology.orchestra.run.smithi032:> uname -m 2023-07-24T05:20:49.026 INFO:teuthology.orchestra.run.smithi032.stdout:x86_64 2023-07-24T05:20:49.027 DEBUG:teuthology.orchestra.run.smithi032:> cat /etc/os-release 2023-07-24T05:20:49.084 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="Red Hat Enterprise Linux" 2023-07-24T05:20:49.084 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="8.6 (Ootpa)" 2023-07-24T05:20:49.084 INFO:teuthology.orchestra.run.smithi032.stdout:ID="rhel" 2023-07-24T05:20:49.085 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE="fedora" 2023-07-24T05:20:49.085 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="8.6" 2023-07-24T05:20:49.085 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM_ID="platform:el8" 2023-07-24T05:20:49.085 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-24T05:20:49.085 INFO:teuthology.orchestra.run.smithi032.stdout:ANSI_COLOR="0;31" 2023-07-24T05:20:49.085 INFO:teuthology.orchestra.run.smithi032.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-24T05:20:49.085 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://www.redhat.com/" 2023-07-24T05:20:49.086 INFO:teuthology.orchestra.run.smithi032.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-24T05:20:49.086 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-24T05:20:49.086 INFO:teuthology.orchestra.run.smithi032.stdout: 2023-07-24T05:20:49.086 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-24T05:20:49.086 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-24T05:20:49.086 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-24T05:20:49.086 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-24T05:20:49.087 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server 2023-07-24T05:20:49.111 INFO:teuthology.lock.ops:Updating [smithi194.front.sepia.ceph.com]: set os type and version on server 2023-07-24T05:20:49.111 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2023-07-24T05:20:49.112 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:20:49.176 DEBUG:teuthology.orchestra.run.smithi194:> true 2023-07-24T05:20:49.200 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com' 2023-07-24T05:20:49.200 DEBUG:teuthology.orchestra.run.smithi194:> uname -m 2023-07-24T05:20:49.256 INFO:teuthology.orchestra.run.smithi194.stdout:x86_64 2023-07-24T05:20:49.257 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release 2023-07-24T05:20:49.316 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="Red Hat Enterprise Linux" 2023-07-24T05:20:49.317 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="8.6 (Ootpa)" 2023-07-24T05:20:49.317 INFO:teuthology.orchestra.run.smithi194.stdout:ID="rhel" 2023-07-24T05:20:49.317 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="fedora" 2023-07-24T05:20:49.317 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="8.6" 2023-07-24T05:20:49.317 INFO:teuthology.orchestra.run.smithi194.stdout:PLATFORM_ID="platform:el8" 2023-07-24T05:20:49.318 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-24T05:20:49.318 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31" 2023-07-24T05:20:49.318 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-24T05:20:49.318 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://www.redhat.com/" 2023-07-24T05:20:49.318 INFO:teuthology.orchestra.run.smithi194.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-24T05:20:49.318 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-24T05:20:49.318 INFO:teuthology.orchestra.run.smithi194.stdout: 2023-07-24T05:20:49.319 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-24T05:20:49.319 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-24T05:20:49.319 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-24T05:20:49.319 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-24T05:20:49.319 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2023-07-24T05:20:49.344 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-24T05:20:49.344 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-24T05:20:49.443 INFO:teuthology.dispatcher.supervisor:Running job 7349250 2023-07-24T05:20:49.443 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_1426592083662fef3e03bbeec33624331f0fdbc1/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-07-24_05:02:48-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7349250 --name vshankar-2023-07-24_05:02:48-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/exports} -- /home/teuthworker/archive/vshankar-2023-07-24_05:02:48-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7349250/orig.config.yaml 2023-07-24T05:20:49.447 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-07-24_05:02:48-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7349250 2023-07-24T05:20:49.448 INFO:teuthology.dispatcher.supervisor:Job PID: 2512 2023-07-24T05:20:49.448 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-24T05:22:49.548 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-24T05:22:49.549 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-24T05:24:49.716 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-24T05:24:49.717 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-24T05:26:49.892 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-24T05:26:49.893 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-24T05:28:50.061 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-24T05:28:50.061 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-24T05:30:50.223 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-24T05:30:50.224 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-24T05:32:50.390 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-24T05:32:50.391 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-24T05:34:50.573 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-24T05:34:50.574 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-24T05:34:50.651 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-24T05:34:50.769 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-24T05:34:50.770 INFO:teuthology.nuke:Checking targets against current locks 2023-07-24T05:34:50.825 DEBUG:teuthology.nuke:shortname: smithi032 2023-07-24T05:34:50.826 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-24T05:34:50.849 DEBUG:teuthology.nuke:shortname: smithi194 2023-07-24T05:34:50.849 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-24T05:34:50.852 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi032.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-07-24_05:02:48-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7349250', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-24 05:04:07.319198', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-24T05:34:50.874 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi194.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-07-24_05:02:48-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7349250', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-24 05:04:07.317575', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-24T05:34:50.911 INFO:teuthology.orchestra.console:Power off smithi032 2023-07-24T05:34:50.912 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-24T05:34:50.935 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-24T05:34:50.936 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T05:34:50.960 INFO:teuthology.orchestra.console:Power off smithi194 2023-07-24T05:34:50.961 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-24T05:34:50.972 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-24T05:34:50.983 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-24T05:34:50.984 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-24T05:34:51.010 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-24T05:34:51.074 INFO:teuthology.orchestra.console:Power off for smithi032 completed 2023-07-24T05:34:51.112 INFO:teuthology.orchestra.console:Power off for smithi194 completed 2023-07-24T05:34:51.234 INFO:teuthology.lock.ops:unlocked: smithi032.front.sepia.ceph.com 2023-07-24T05:34:51.258 INFO:teuthology.lock.ops:unlocked: smithi194.front.sepia.ceph.com