2023-07-06T03:15:42.950 INFO:root:teuthology version: 0.0.1.dev140+gb53f236
2023-07-06T03:15:42.952 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-06T03:15:42.952 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-06T03:15:58.107 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7ffb72cf55e0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7ffb7266d820>, signals=[15])
2023-07-06T03:15:58.109 INFO:teuthology.lock.ops:Start node 'smithi031.front.sepia.ceph.com' reimaging
2023-07-06T03:15:58.109 INFO:teuthology.lock.ops:Updating [smithi031.front.sepia.ceph.com]: reset os type and version on server
2023-07-06T03:15:58.110 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server
2023-07-06T03:15:58.134 INFO:teuthology.lock.ops:Start node 'smithi045.front.sepia.ceph.com' reimaging
2023-07-06T03:15:58.135 INFO:teuthology.lock.ops:Updating [smithi045.front.sepia.ceph.com]: reset os type and version on server
2023-07-06T03:15:58.135 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server
2023-07-06T03:15:58.136 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /host {"name": "smithi031"}
2023-07-06T03:15:58.151 INFO:teuthology.lock.ops:Start node 'smithi057.front.sepia.ceph.com' reimaging
2023-07-06T03:15:58.152 INFO:teuthology.lock.ops:Updating [smithi057.front.sepia.ceph.com]: reset os type and version on server
2023-07-06T03:15:58.152 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server
2023-07-06T03:15:58.155 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /host {"name": "smithi045"}
2023-07-06T03:15:58.177 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /host {"name": "smithi057"}
2023-07-06T03:15:58.208 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-07-06T03:15:58.221 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-07-06T03:15:58.251 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-07-06T03:15:58.258 DEBUG:teuthology.provision.fog.smithi031:Requesting image smithi_rhel_8.6 (ID 5)
2023-07-06T03:15:58.258 DEBUG:teuthology.provision.fog.smithi031:FOG request: PUT /host/136 {"imageID": 5}
2023-07-06T03:15:58.268 DEBUG:teuthology.provision.fog.smithi045:Requesting image smithi_rhel_8.6 (ID 5)
2023-07-06T03:15:58.268 DEBUG:teuthology.provision.fog.smithi045:FOG request: PUT /host/150 {"imageID": 5}
2023-07-06T03:15:58.301 DEBUG:teuthology.provision.fog.smithi057:Requesting image smithi_rhel_8.6 (ID 5)
2023-07-06T03:15:58.301 DEBUG:teuthology.provision.fog.smithi057:FOG request: PUT /host/162 {"imageID": 5}
2023-07-06T03:15:58.310 INFO:teuthology.provision.fog.smithi045:Scheduling deploy of rhel 8.6
2023-07-06T03:15:58.311 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None
2023-07-06T03:15:58.313 INFO:teuthology.provision.fog.smithi031:Scheduling deploy of rhel 8.6
2023-07-06T03:15:58.314 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None
2023-07-06T03:15:58.349 INFO:teuthology.provision.fog.smithi057:Scheduling deploy of rhel 8.6
2023-07-06T03:15:58.349 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None
2023-07-06T03:15:58.358 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /tasktype {"name": "deploy"}
2023-07-06T03:15:58.362 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /tasktype {"name": "deploy"}
2023-07-06T03:15:58.388 DEBUG:teuthology.provision.fog.smithi031:FOG request: POST /host/136/task {"taskTypeID": 1}
2023-07-06T03:15:58.403 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /tasktype {"name": "deploy"}
2023-07-06T03:15:58.406 DEBUG:teuthology.provision.fog.smithi045:FOG request: POST /host/150/task {"taskTypeID": 1}
2023-07-06T03:15:58.442 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None
2023-07-06T03:15:58.444 DEBUG:teuthology.provision.fog.smithi057:FOG request: POST /host/162/task {"taskTypeID": 1}
2023-07-06T03:15:58.460 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None
2023-07-06T03:15:58.492 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None
2023-07-06T03:15:58.546 INFO:teuthology.orchestra.console:Power off smithi031
2023-07-06T03:15:58.547 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-06T03:15:58.568 INFO:teuthology.orchestra.console:Power off smithi045
2023-07-06T03:15:58.569 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-06T03:15:58.580 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T03:15:58.592 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T03:15:58.608 INFO:teuthology.orchestra.console:Power off smithi057
2023-07-06T03:15:58.609 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-06T03:15:58.631 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T03:16:02.608 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T03:16:02.618 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T03:16:02.656 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T03:16:06.721 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T03:16:06.730 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T03:16:06.768 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T03:16:11.833 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T03:16:11.840 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T03:16:11.878 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T03:16:16.944 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T03:16:16.952 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T03:16:16.989 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T03:16:22.055 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T03:16:22.063 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T03:16:22.099 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T03:16:27.171 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T03:16:27.178 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T03:16:27.209 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T03:16:32.283 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T03:16:32.291 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T03:16:32.318 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T03:16:37.396 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T03:16:37.405 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T03:16:37.427 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T03:16:42.509 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T03:16:42.517 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T03:16:42.538 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T03:16:47.621 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T03:16:47.629 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T03:16:47.648 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T03:16:52.733 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T03:16:52.741 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T03:16:52.757 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T03:16:57.844 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T03:16:57.853 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T03:16:57.868 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T03:16:58.064 INFO:teuthology.orchestra.console:Power off for smithi045 completed
2023-07-06T03:16:58.079 INFO:teuthology.orchestra.console:Power off for smithi057 completed
2023-07-06T03:16:58.166 INFO:teuthology.orchestra.console:Power on smithi045
2023-07-06T03:16:58.166 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-06T03:16:58.180 INFO:teuthology.orchestra.console:Power on smithi057
2023-07-06T03:16:58.181 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-06T03:16:58.189 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T03:16:58.201 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T03:17:02.212 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T03:17:02.221 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T03:17:02.956 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T03:17:07.325 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T03:17:07.332 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T03:17:08.068 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T03:17:09.180 WARNING:teuthology.contextutil:'wait for power off' reached maximum tries (16) after waiting for 60.0 seconds
2023-07-06T03:17:09.181 ERROR:teuthology.orchestra.console:Failed to power off smithi031
2023-07-06T03:17:09.181 INFO:teuthology.orchestra.console:Power on smithi031
2023-07-06T03:17:09.181 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-06T03:17:12.435 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T03:17:12.443 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T03:17:17.547 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T03:17:17.555 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T03:17:19.209 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T03:17:22.658 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T03:17:22.665 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T03:17:22.876 INFO:teuthology.orchestra.console:Power on for smithi057 completed
2023-07-06T03:17:22.977 INFO:teuthology.provision.fog.smithi057:Waiting for deploy to finish
2023-07-06T03:17:22.978 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None
2023-07-06T03:17:27.400 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T03:17:31.411 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T03:17:32.509 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T03:17:32.719 INFO:teuthology.orchestra.console:Power on for smithi031 completed
2023-07-06T03:17:32.820 INFO:teuthology.provision.fog.smithi031:Waiting for deploy to finish
2023-07-06T03:17:32.821 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None
2023-07-06T03:17:37.829 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T03:17:42.473 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None
2023-07-06T03:17:47.481 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T03:17:52.592 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T03:17:52.901 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None
2023-07-06T03:17:58.010 INFO:teuthology.orchestra.console:Power on for smithi045 completed
2023-07-06T03:17:58.111 INFO:teuthology.provision.fog.smithi045:Waiting for deploy to finish
2023-07-06T03:17:58.111 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None
2023-07-06T03:18:02.556 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None
2023-07-06T03:18:12.968 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None
2023-07-06T03:18:13.293 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None
2023-07-06T03:18:22.624 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None
2023-07-06T03:18:32.636 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None
2023-07-06T03:18:32.637 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None
2023-07-06T03:18:47.712 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None
2023-07-06T03:18:47.713 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None
2023-07-06T03:18:47.936 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None
2023-07-06T03:19:03.007 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None
2023-07-06T03:19:07.959 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None
2023-07-06T03:19:07.961 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None
2023-07-06T03:19:23.032 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None
2023-07-06T03:19:28.037 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None
2023-07-06T03:19:28.038 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None
2023-07-06T03:19:33.102 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-06T03:19:36.176 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45
2023-07-06T03:19:42.180 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-06T03:19:45.232 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45
2023-07-06T03:19:48.108 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None
2023-07-06T03:19:48.110 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None
2023-07-06T03:19:58.121 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-06T03:20:03.178 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-06T03:20:08.183 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45
2023-07-06T03:20:08.185 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-06T03:20:13.188 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31
2023-07-06T03:20:14.184 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-06T03:20:16.240 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57
2023-07-06T03:20:17.264 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45
2023-07-06T03:20:19.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-06T03:20:24.193 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-06T03:20:24.195 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-06T03:20:27.248 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57
2023-07-06T03:20:27.249 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31
2023-07-06T03:20:33.253 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-06T03:20:38.255 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-06T03:20:43.260 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57
2023-07-06T03:20:49.267 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-06T03:21:01.808 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31
2023-07-06T03:21:07.812 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-06T03:21:09.017 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-06T03:21:09.018 DEBUG:teuthology.orchestra.run.smithi031:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-06T03:21:09.370 INFO:teuthology.provision.fog.smithi031:Node is ready
2023-07-06T03:21:09.370 DEBUG:teuthology.orchestra.run.smithi031:> hostname
2023-07-06T03:21:09.397 INFO:teuthology.orchestra.run.smithi031.stdout:smithi022
2023-07-06T03:21:09.397 DEBUG:teuthology.orchestra.run.smithi031:> grep smithi022 /etc/hosts
2023-07-06T03:21:09.455 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022
2023-07-06T03:21:09.456 DEBUG:teuthology.orchestra.run.smithi031:> sudo hostname smithi031
2023-07-06T03:21:09.584 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/smithi022/smithi031/g' /etc/hosts
2023-07-06T03:21:09.613 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/172.21.15.22/172.21.15.31/g' /etc/hosts
2023-07-06T03:21:09.681 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/smithi022/smithi031/g' /etc/hostname
2023-07-06T03:21:09.749 DEBUG:teuthology.orchestra.run.smithi031:> sudo hostname smithi031
2023-07-06T03:21:09.815 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release
2023-07-06T03:21:09.871 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="Red Hat Enterprise Linux"
2023-07-06T03:21:09.871 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="8.6 (Ootpa)"
2023-07-06T03:21:09.871 INFO:teuthology.orchestra.run.smithi031.stdout:ID="rhel"
2023-07-06T03:21:09.871 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE="fedora"
2023-07-06T03:21:09.872 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="8.6"
2023-07-06T03:21:09.872 INFO:teuthology.orchestra.run.smithi031.stdout:PLATFORM_ID="platform:el8"
2023-07-06T03:21:09.872 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-06T03:21:09.872 INFO:teuthology.orchestra.run.smithi031.stdout:ANSI_COLOR="0;31"
2023-07-06T03:21:09.872 INFO:teuthology.orchestra.run.smithi031.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-06T03:21:09.872 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://www.redhat.com/"
2023-07-06T03:21:09.872 INFO:teuthology.orchestra.run.smithi031.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-06T03:21:09.873 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-06T03:21:09.873 INFO:teuthology.orchestra.run.smithi031.stdout:
2023-07-06T03:21:09.873 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-06T03:21:09.873 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-06T03:21:09.873 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-06T03:21:09.873 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-06T03:21:09.874 INFO:teuthology.provision.fog.smithi031:Deploy complete!
2023-07-06T03:21:09.875 DEBUG:teuthology.parallel:result is None
2023-07-06T03:21:24.208 WARNING:teuthology.provision.fog.smithi045:timed out
2023-07-06T03:21:30.212 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-06T03:21:35.554 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-06T03:21:35.555 DEBUG:teuthology.orchestra.run.smithi045:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-06T03:21:35.860 INFO:teuthology.provision.fog.smithi045:Node is ready
2023-07-06T03:21:35.861 DEBUG:teuthology.orchestra.run.smithi045:> hostname
2023-07-06T03:21:35.878 INFO:teuthology.orchestra.run.smithi045.stdout:smithi045.front.sepia.ceph.com
2023-07-06T03:21:35.879 DEBUG:teuthology.orchestra.run.smithi045:> grep smithi045.front.sepia.ceph.com /etc/hosts
2023-07-06T03:21:35.938 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45 smithi045.front.sepia.ceph.com smithi045
2023-07-06T03:21:35.938 DEBUG:teuthology.orchestra.run.smithi045:> sudo hostname smithi045
2023-07-06T03:21:36.091 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i -e 's/smithi045.front.sepia.ceph.com/smithi045/g' /etc/hosts
2023-07-06T03:21:36.121 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i -e 's/172.21.15.45/172.21.15.45/g' /etc/hosts
2023-07-06T03:21:36.191 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i -e 's/smithi045.front.sepia.ceph.com/smithi045/g' /etc/hostname
2023-07-06T03:21:36.259 DEBUG:teuthology.orchestra.run.smithi045:> sudo hostname smithi045
2023-07-06T03:21:36.327 DEBUG:teuthology.orchestra.run.smithi045:> cat /etc/os-release
2023-07-06T03:21:36.384 INFO:teuthology.orchestra.run.smithi045.stdout:NAME="Red Hat Enterprise Linux"
2023-07-06T03:21:36.384 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION="8.6 (Ootpa)"
2023-07-06T03:21:36.384 INFO:teuthology.orchestra.run.smithi045.stdout:ID="rhel"
2023-07-06T03:21:36.384 INFO:teuthology.orchestra.run.smithi045.stdout:ID_LIKE="fedora"
2023-07-06T03:21:36.384 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_ID="8.6"
2023-07-06T03:21:36.385 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM_ID="platform:el8"
2023-07-06T03:21:36.385 INFO:teuthology.orchestra.run.smithi045.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-06T03:21:36.385 INFO:teuthology.orchestra.run.smithi045.stdout:ANSI_COLOR="0;31"
2023-07-06T03:21:36.385 INFO:teuthology.orchestra.run.smithi045.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-06T03:21:36.385 INFO:teuthology.orchestra.run.smithi045.stdout:HOME_URL="https://www.redhat.com/"
2023-07-06T03:21:36.385 INFO:teuthology.orchestra.run.smithi045.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-06T03:21:36.385 INFO:teuthology.orchestra.run.smithi045.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-06T03:21:36.386 INFO:teuthology.orchestra.run.smithi045.stdout:
2023-07-06T03:21:36.386 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-06T03:21:36.386 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-06T03:21:36.386 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-06T03:21:36.386 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-06T03:21:36.386 INFO:teuthology.provision.fog.smithi045:Deploy complete!
2023-07-06T03:21:36.387 DEBUG:teuthology.parallel:result is None
2023-07-06T03:21:54.290 WARNING:teuthology.provision.fog.smithi057:timed out
2023-07-06T03:22:00.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-06T03:22:05.535 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-06T03:22:05.535 DEBUG:teuthology.orchestra.run.smithi057:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-06T03:22:05.882 INFO:teuthology.provision.fog.smithi057:Node is ready
2023-07-06T03:22:05.882 DEBUG:teuthology.orchestra.run.smithi057:> hostname
2023-07-06T03:22:05.900 INFO:teuthology.orchestra.run.smithi057.stdout:smithi057.front.sepia.ceph.com
2023-07-06T03:22:05.900 DEBUG:teuthology.orchestra.run.smithi057:> grep smithi057.front.sepia.ceph.com /etc/hosts
2023-07-06T03:22:05.958 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57 smithi057.front.sepia.ceph.com smithi057
2023-07-06T03:22:05.959 DEBUG:teuthology.orchestra.run.smithi057:> sudo hostname smithi057
2023-07-06T03:22:06.091 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/smithi057.front.sepia.ceph.com/smithi057/g' /etc/hosts
2023-07-06T03:22:06.121 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/172.21.15.57/172.21.15.57/g' /etc/hosts
2023-07-06T03:22:06.189 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/smithi057.front.sepia.ceph.com/smithi057/g' /etc/hostname
2023-07-06T03:22:06.256 DEBUG:teuthology.orchestra.run.smithi057:> sudo hostname smithi057
2023-07-06T03:22:06.324 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release
2023-07-06T03:22:06.380 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="Red Hat Enterprise Linux"
2023-07-06T03:22:06.381 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="8.6 (Ootpa)"
2023-07-06T03:22:06.381 INFO:teuthology.orchestra.run.smithi057.stdout:ID="rhel"
2023-07-06T03:22:06.381 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE="fedora"
2023-07-06T03:22:06.381 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="8.6"
2023-07-06T03:22:06.381 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM_ID="platform:el8"
2023-07-06T03:22:06.382 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-06T03:22:06.382 INFO:teuthology.orchestra.run.smithi057.stdout:ANSI_COLOR="0;31"
2023-07-06T03:22:06.382 INFO:teuthology.orchestra.run.smithi057.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-06T03:22:06.382 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://www.redhat.com/"
2023-07-06T03:22:06.382 INFO:teuthology.orchestra.run.smithi057.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-06T03:22:06.382 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-06T03:22:06.383 INFO:teuthology.orchestra.run.smithi057.stdout:
2023-07-06T03:22:06.383 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-06T03:22:06.383 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-06T03:22:06.383 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-06T03:22:06.384 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-06T03:22:06.384 INFO:teuthology.provision.fog.smithi057:Deploy complete!
2023-07-06T03:22:06.385 DEBUG:teuthology.parallel:result is None
2023-07-06T03:22:21.587 INFO:teuthology.lock.ops:Checking smithi031.front.sepia.ceph.com
2023-07-06T03:22:21.588 INFO:teuthology.lock.ops:Checking smithi045.front.sepia.ceph.com
2023-07-06T03:22:21.588 INFO:teuthology.lock.ops:Checking smithi057.front.sepia.ceph.com
2023-07-06T03:22:21.589 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-06T03:22:26.630 INFO:teuthology.lock.ops:Updating [smithi031.front.sepia.ceph.com]: set os type and version on server
2023-07-06T03:22:26.630 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com'
2023-07-06T03:22:26.631 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-06T03:22:26.699 DEBUG:teuthology.orchestra.run.smithi031:> true
2023-07-06T03:22:26.838 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi031.front.sepia.ceph.com'
2023-07-06T03:22:26.839 DEBUG:teuthology.orchestra.run.smithi031:> uname -m
2023-07-06T03:22:26.896 INFO:teuthology.orchestra.run.smithi031.stdout:x86_64
2023-07-06T03:22:26.897 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release
2023-07-06T03:22:26.954 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="Red Hat Enterprise Linux"
2023-07-06T03:22:26.955 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="8.6 (Ootpa)"
2023-07-06T03:22:26.955 INFO:teuthology.orchestra.run.smithi031.stdout:ID="rhel"
2023-07-06T03:22:26.955 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE="fedora"
2023-07-06T03:22:26.955 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="8.6"
2023-07-06T03:22:26.955 INFO:teuthology.orchestra.run.smithi031.stdout:PLATFORM_ID="platform:el8"
2023-07-06T03:22:26.955 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-06T03:22:26.956 INFO:teuthology.orchestra.run.smithi031.stdout:ANSI_COLOR="0;31"
2023-07-06T03:22:26.956 INFO:teuthology.orchestra.run.smithi031.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-06T03:22:26.956 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://www.redhat.com/"
2023-07-06T03:22:26.956 INFO:teuthology.orchestra.run.smithi031.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-06T03:22:26.956 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-06T03:22:26.956 INFO:teuthology.orchestra.run.smithi031.stdout:
2023-07-06T03:22:26.957 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-06T03:22:26.957 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-06T03:22:26.957 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-06T03:22:26.957 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-06T03:22:26.958 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server
2023-07-06T03:22:31.986 INFO:teuthology.lock.ops:Updating [smithi045.front.sepia.ceph.com]: set os type and version on server
2023-07-06T03:22:31.986 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com'
2023-07-06T03:22:31.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-06T03:22:37.058 DEBUG:teuthology.orchestra.run.smithi045:> true
2023-07-06T03:22:37.191 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi045.front.sepia.ceph.com'
2023-07-06T03:22:37.191 DEBUG:teuthology.orchestra.run.smithi045:> uname -m
2023-07-06T03:22:37.249 INFO:teuthology.orchestra.run.smithi045.stdout:x86_64
2023-07-06T03:22:37.250 DEBUG:teuthology.orchestra.run.smithi045:> cat /etc/os-release
2023-07-06T03:22:37.308 INFO:teuthology.orchestra.run.smithi045.stdout:NAME="Red Hat Enterprise Linux"
2023-07-06T03:22:37.308 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION="8.6 (Ootpa)"
2023-07-06T03:22:37.309 INFO:teuthology.orchestra.run.smithi045.stdout:ID="rhel"
2023-07-06T03:22:37.309 INFO:teuthology.orchestra.run.smithi045.stdout:ID_LIKE="fedora"
2023-07-06T03:22:37.309 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_ID="8.6"
2023-07-06T03:22:37.309 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM_ID="platform:el8"
2023-07-06T03:22:37.309 INFO:teuthology.orchestra.run.smithi045.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-06T03:22:37.310 INFO:teuthology.orchestra.run.smithi045.stdout:ANSI_COLOR="0;31"
2023-07-06T03:22:37.310 INFO:teuthology.orchestra.run.smithi045.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-06T03:22:37.310 INFO:teuthology.orchestra.run.smithi045.stdout:HOME_URL="https://www.redhat.com/"
2023-07-06T03:22:37.310 INFO:teuthology.orchestra.run.smithi045.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-06T03:22:37.310 INFO:teuthology.orchestra.run.smithi045.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-06T03:22:37.311 INFO:teuthology.orchestra.run.smithi045.stdout:
2023-07-06T03:22:37.311 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-06T03:22:37.311 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-06T03:22:37.311 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-06T03:22:37.311 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-06T03:22:37.312 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server
2023-07-06T03:22:42.343 INFO:teuthology.lock.ops:Updating [smithi057.front.sepia.ceph.com]: set os type and version on server
2023-07-06T03:22:42.343 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com'
2023-07-06T03:22:42.344 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-06T03:22:47.415 DEBUG:teuthology.orchestra.run.smithi057:> true
2023-07-06T03:22:47.551 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi057.front.sepia.ceph.com'
2023-07-06T03:22:47.552 DEBUG:teuthology.orchestra.run.smithi057:> uname -m
2023-07-06T03:22:47.610 INFO:teuthology.orchestra.run.smithi057.stdout:x86_64
2023-07-06T03:22:47.611 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release
2023-07-06T03:22:47.669 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="Red Hat Enterprise Linux"
2023-07-06T03:22:47.670 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="8.6 (Ootpa)"
2023-07-06T03:22:47.670 INFO:teuthology.orchestra.run.smithi057.stdout:ID="rhel"
2023-07-06T03:22:47.670 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE="fedora"
2023-07-06T03:22:47.671 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="8.6"
2023-07-06T03:22:47.671 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM_ID="platform:el8"
2023-07-06T03:22:47.671 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-06T03:22:47.672 INFO:teuthology.orchestra.run.smithi057.stdout:ANSI_COLOR="0;31"
2023-07-06T03:22:47.672 INFO:teuthology.orchestra.run.smithi057.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-06T03:22:47.672 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://www.redhat.com/"
2023-07-06T03:22:47.672 INFO:teuthology.orchestra.run.smithi057.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-06T03:22:47.673 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-06T03:22:47.673 INFO:teuthology.orchestra.run.smithi057.stdout:
2023-07-06T03:22:47.673 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-06T03:22:47.674 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-06T03:22:47.674 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-06T03:22:47.674 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-06T03:22:47.675 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server
2023-07-06T03:22:52.708 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-06T03:22:52.709 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-06T03:22:52.864 INFO:teuthology.dispatcher.supervisor:Running job 7327894
2023-07-06T03:22:52.864 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-07-05_22:21:20-fs-wip-rishabh-2023Jul5-testing-default-smithi/7327894 --name rishabh-2023-07-05_22:21:20-fs-wip-rishabh-2023Jul5-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{no-subvolume} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/suites/dbench}} -- /home/teuthworker/archive/rishabh-2023-07-05_22:21:20-fs-wip-rishabh-2023Jul5-testing-default-smithi/7327894/orig.config.yaml
2023-07-06T03:22:52.868 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-07-05_22:21:20-fs-wip-rishabh-2023Jul5-testing-default-smithi/7327894
2023-07-06T03:22:52.870 INFO:teuthology.dispatcher.supervisor:Job PID: 18738
2023-07-06T03:22:52.870 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-07-06T03:24:52.969 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-06T03:24:52.971 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-06T03:26:58.148 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-06T03:26:58.149 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-06T03:29:00.681 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-06T03:29:00.682 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-06T03:31:01.281 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-06T03:31:01.282 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-06T03:33:02.257 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-06T03:33:02.257 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-06T03:35:07.447 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-06T03:35:07.448 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-06T03:37:12.625 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-06T03:37:12.626 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-06T03:39:13.941 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-06T03:39:13.941 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-06T03:41:19.129 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-06T03:41:19.129 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-06T03:43:23.709 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-06T03:43:23.710 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-06T03:45:28.909 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-06T03:45:28.909 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-06T03:47:32.673 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-06T03:47:32.674 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-06T03:49:37.850 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-06T03:49:37.851 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-06T03:49:40.531 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-07-06T03:49:45.765 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-07-06T03:49:45.765 INFO:teuthology.nuke:Checking targets against current locks
2023-07-06T03:49:45.809 DEBUG:teuthology.nuke:shortname: smithi031
2023-07-06T03:49:45.810 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-06T03:49:45.840 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi031.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-05_22:21:20-fs-wip-rishabh-2023Jul5-testing-default-smithi/7327894', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-06 03:15:37.078443', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}
2023-07-06T03:49:45.843 DEBUG:teuthology.nuke:shortname: smithi045
2023-07-06T03:49:45.843 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-06T03:49:45.868 DEBUG:teuthology.nuke:shortname: smithi057
2023-07-06T03:49:45.868 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-06T03:49:45.872 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi045.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-05_22:21:20-fs-wip-rishabh-2023Jul5-testing-default-smithi/7327894', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-06 03:15:37.080714', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}
2023-07-06T03:49:45.898 INFO:teuthology.orchestra.console:Power off smithi031
2023-07-06T03:49:45.899 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-06T03:49:45.909 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi057.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-05_22:21:20-fs-wip-rishabh-2023Jul5-testing-default-smithi/7327894', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-06 03:15:37.081959', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}
2023-07-06T03:49:45.920 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T03:49:45.941 INFO:teuthology.orchestra.console:Power off smithi045
2023-07-06T03:49:45.942 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-06T03:49:45.963 INFO:teuthology.orchestra.console:Power off smithi057
2023-07-06T03:49:45.964 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-06T03:49:45.974 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T03:49:45.985 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-06T03:49:46.084 INFO:teuthology.orchestra.console:Power off for smithi031 completed
2023-07-06T03:49:46.098 INFO:teuthology.orchestra.console:Power off for smithi045 completed
2023-07-06T03:49:46.109 INFO:teuthology.orchestra.console:Power off for smithi057 completed
2023-07-06T03:49:46.236 INFO:teuthology.lock.ops:unlocked: smithi031.front.sepia.ceph.com
2023-07-06T03:49:46.243 INFO:teuthology.lock.ops:unlocked: smithi045.front.sepia.ceph.com
2023-07-06T03:49:46.260 INFO:teuthology.lock.ops:unlocked: smithi057.front.sepia.ceph.com