2023-07-20T01:01:54.134 INFO:root:teuthology version: 0.0.1.dev153+g79491cb 2023-07-20T01:01:54.135 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T01:01:54.136 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T01:01:54.339 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8007376a60>, signals=[15]) 2023-07-20T01:01:54.340 INFO:teuthology.lock.ops:Start node 'smithi118.front.sepia.ceph.com' reimaging 2023-07-20T01:01:54.341 INFO:teuthology.lock.ops:Updating [smithi118.front.sepia.ceph.com]: reset os type and version on server 2023-07-20T01:01:54.341 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server 2023-07-20T01:01:54.360 INFO:teuthology.lock.ops:Start node 'smithi140.front.sepia.ceph.com' reimaging 2023-07-20T01:01:54.360 INFO:teuthology.lock.ops:Updating [smithi140.front.sepia.ceph.com]: reset os type and version on server 2023-07-20T01:01:54.361 INFO:teuthology.lock.ops:Updating smithi140.front.sepia.ceph.com on lock server 2023-07-20T01:01:54.362 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /host {"name": "smithi118"} 2023-07-20T01:01:54.385 INFO:teuthology.lock.ops:Start node 'smithi162.front.sepia.ceph.com' reimaging 2023-07-20T01:01:54.385 INFO:teuthology.lock.ops:Updating [smithi162.front.sepia.ceph.com]: reset os type and version on server 2023-07-20T01:01:54.385 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server 2023-07-20T01:01:54.387 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /host {"name": "smithi140"} 2023-07-20T01:01:54.410 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /host {"name": "smithi162"} 2023-07-20T01:01:54.444 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-20T01:01:54.460 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-20T01:01:54.472 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-20T01:01:54.485 DEBUG:teuthology.provision.fog.smithi118:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-20T01:01:54.485 DEBUG:teuthology.provision.fog.smithi118:FOG request: PUT /host/223 {"imageID": 5} 2023-07-20T01:01:54.505 DEBUG:teuthology.provision.fog.smithi140:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-20T01:01:54.506 DEBUG:teuthology.provision.fog.smithi140:FOG request: PUT /host/245 {"imageID": 5} 2023-07-20T01:01:54.516 DEBUG:teuthology.provision.fog.smithi162:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-20T01:01:54.516 DEBUG:teuthology.provision.fog.smithi162:FOG request: PUT /host/267 {"imageID": 5} 2023-07-20T01:01:54.529 INFO:teuthology.provision.fog.smithi118:Scheduling deploy of rhel 8.6 2023-07-20T01:01:54.529 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-20T01:01:54.547 INFO:teuthology.provision.fog.smithi140:Scheduling deploy of rhel 8.6 2023-07-20T01:01:54.547 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-20T01:01:54.554 INFO:teuthology.provision.fog.smithi162:Scheduling deploy of rhel 8.6 2023-07-20T01:01:54.554 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-07-20T01:01:54.566 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /tasktype {"name": "deploy"} 2023-07-20T01:01:54.580 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /tasktype {"name": "deploy"} 2023-07-20T01:01:54.586 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /tasktype {"name": "deploy"} 2023-07-20T01:01:54.601 DEBUG:teuthology.provision.fog.smithi118:FOG request: POST /host/223/task {"taskTypeID": 1} 2023-07-20T01:01:54.609 DEBUG:teuthology.provision.fog.smithi140:FOG request: POST /host/245/task {"taskTypeID": 1} 2023-07-20T01:01:54.634 DEBUG:teuthology.provision.fog.smithi162:FOG request: POST /host/267/task {"taskTypeID": 1} 2023-07-20T01:01:54.670 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-20T01:01:54.676 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-20T01:01:54.686 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-07-20T01:01:54.763 INFO:teuthology.orchestra.console:Power off smithi140 2023-07-20T01:01:54.764 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-20T01:01:54.780 INFO:teuthology.orchestra.console:Power off smithi162 2023-07-20T01:01:54.781 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-20T01:01:54.793 INFO:teuthology.orchestra.console:Power off smithi118 2023-07-20T01:01:54.794 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-20T01:01:54.802 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T01:01:54.812 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T01:01:54.823 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T01:01:54.937 INFO:teuthology.orchestra.console:Power off for smithi162 completed 2023-07-20T01:01:55.038 INFO:teuthology.orchestra.console:Power on smithi162 2023-07-20T01:01:55.038 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-20T01:01:55.058 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T01:01:58.835 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T01:01:58.846 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T01:01:59.078 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T01:02:02.948 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T01:02:02.959 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T01:02:03.171 INFO:teuthology.orchestra.console:Power off for smithi118 completed 2023-07-20T01:02:03.189 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T01:02:03.273 INFO:teuthology.orchestra.console:Power on smithi118 2023-07-20T01:02:03.273 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-20T01:02:03.293 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T01:02:03.405 INFO:teuthology.orchestra.console:Power on for smithi162 completed 2023-07-20T01:02:03.506 INFO:teuthology.provision.fog.smithi162:Waiting for deploy to finish 2023-07-20T01:02:03.506 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-07-20T01:02:07.064 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T01:02:07.274 INFO:teuthology.orchestra.console:Power off for smithi140 completed 2023-07-20T01:02:07.317 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T01:02:07.375 INFO:teuthology.orchestra.console:Power on smithi140 2023-07-20T01:02:07.376 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-20T01:02:07.397 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T01:02:11.423 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T01:02:11.431 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T01:02:11.634 INFO:teuthology.orchestra.console:Power on for smithi140 completed 2023-07-20T01:02:11.641 INFO:teuthology.orchestra.console:Power on for smithi118 completed 2023-07-20T01:02:11.735 INFO:teuthology.provision.fog.smithi140:Waiting for deploy to finish 2023-07-20T01:02:11.736 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-20T01:02:11.741 INFO:teuthology.provision.fog.smithi118:Waiting for deploy to finish 2023-07-20T01:02:11.742 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-20T01:02:18.570 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-07-20T01:02:26.810 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-20T01:02:26.811 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-20T01:02:33.630 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-07-20T01:02:41.868 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-20T01:02:41.870 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-20T01:02:48.692 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-07-20T01:02:56.928 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-20T01:02:56.929 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-20T01:03:03.760 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-07-20T01:03:11.992 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-20T01:03:11.994 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-20T01:03:18.823 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-07-20T01:03:27.052 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-20T01:03:27.054 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-20T01:03:33.880 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-07-20T01:03:42.112 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-20T01:03:42.113 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-20T01:03:48.937 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-07-20T01:03:57.181 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-20T01:03:57.184 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-20T01:04:03.992 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-07-20T01:04:12.240 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-20T01:04:12.241 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-20T01:04:19.048 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-07-20T01:04:27.299 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-20T01:04:27.300 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-20T01:04:34.104 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-07-20T01:04:42.356 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-20T01:04:42.357 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-20T01:04:49.168 DEBUG:teuthology.provision.fog.smithi162:FOG request: GET /task/active None 2023-07-20T01:04:49.219 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:04:52.272 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-07-20T01:04:57.411 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-20T01:04:57.412 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-20T01:04:58.275 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:05:01.332 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-07-20T01:05:07.336 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:05:10.416 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-07-20T01:05:12.460 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-20T01:05:12.462 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-20T01:05:12.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:05:16.420 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:05:19.476 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-07-20T01:05:25.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:05:27.512 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-07-20T01:05:27.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:05:28.560 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-07-20T01:05:30.992 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:05:34.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:05:36.996 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:05:37.618 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-07-20T01:05:40.048 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:05:43.621 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:05:46.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:05:46.096 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-07-20T01:05:46.676 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-07-20T01:05:49.104 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:05:52.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:05:52.678 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:05:55.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:05:55.152 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-07-20T01:05:55.732 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-07-20T01:05:58.160 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:06:01.156 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:06:01.734 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:06:04.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:06:04.212 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-07-20T01:06:04.784 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-07-20T01:06:07.216 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:06:10.216 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:06:10.786 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:06:13.219 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:06:13.296 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-07-20T01:06:13.844 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-07-20T01:06:19.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:06:19.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:06:22.352 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-07-20T01:06:22.896 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-07-20T01:06:28.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:06:28.898 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:06:31.408 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-07-20T01:06:31.952 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-07-20T01:06:37.415 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:06:37.954 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:06:41.008 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-07-20T01:06:47.012 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:07:13.235 WARNING:teuthology.provision.fog.smithi140:timed out 2023-07-20T01:07:19.237 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:07:37.432 WARNING:teuthology.provision.fog.smithi118:timed out 2023-07-20T01:07:37.712 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:07:43.435 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:07:43.714 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:07:43.794 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-20T01:07:43.795 DEBUG:teuthology.orchestra.run.smithi118:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-20T01:07:44.071 INFO:teuthology.provision.fog.smithi118:Node is ready 2023-07-20T01:07:44.072 DEBUG:teuthology.orchestra.run.smithi118:> hostname 2023-07-20T01:07:44.091 INFO:teuthology.orchestra.run.smithi118.stdout:smithi118.front.sepia.ceph.com 2023-07-20T01:07:44.092 DEBUG:teuthology.orchestra.run.smithi118:> grep smithi118.front.sepia.ceph.com /etc/hosts 2023-07-20T01:07:44.152 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118 smithi118.front.sepia.ceph.com smithi118 2023-07-20T01:07:44.153 DEBUG:teuthology.orchestra.run.smithi118:> sudo hostname smithi118 2023-07-20T01:07:44.271 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i -e 's/smithi118.front.sepia.ceph.com/smithi118/g' /etc/hosts 2023-07-20T01:07:44.303 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i -e 's/172.21.15.118/172.21.15.118/g' /etc/hosts 2023-07-20T01:07:44.373 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i -e 's/smithi118.front.sepia.ceph.com/smithi118/g' /etc/hostname 2023-07-20T01:07:44.443 DEBUG:teuthology.orchestra.run.smithi118:> sudo hostname smithi118 2023-07-20T01:07:44.511 DEBUG:teuthology.orchestra.run.smithi118:> cat /etc/os-release 2023-07-20T01:07:44.568 INFO:teuthology.orchestra.run.smithi118.stdout:NAME="Red Hat Enterprise Linux" 2023-07-20T01:07:44.568 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION="8.6 (Ootpa)" 2023-07-20T01:07:44.569 INFO:teuthology.orchestra.run.smithi118.stdout:ID="rhel" 2023-07-20T01:07:44.569 INFO:teuthology.orchestra.run.smithi118.stdout:ID_LIKE="fedora" 2023-07-20T01:07:44.569 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_ID="8.6" 2023-07-20T01:07:44.569 INFO:teuthology.orchestra.run.smithi118.stdout:PLATFORM_ID="platform:el8" 2023-07-20T01:07:44.569 INFO:teuthology.orchestra.run.smithi118.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-20T01:07:44.569 INFO:teuthology.orchestra.run.smithi118.stdout:ANSI_COLOR="0;31" 2023-07-20T01:07:44.570 INFO:teuthology.orchestra.run.smithi118.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-20T01:07:44.570 INFO:teuthology.orchestra.run.smithi118.stdout:HOME_URL="https://www.redhat.com/" 2023-07-20T01:07:44.570 INFO:teuthology.orchestra.run.smithi118.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-20T01:07:44.570 INFO:teuthology.orchestra.run.smithi118.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-20T01:07:44.570 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-07-20T01:07:44.570 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-20T01:07:44.571 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-20T01:07:44.571 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-20T01:07:44.571 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-20T01:07:44.571 INFO:teuthology.provision.fog.smithi118:Deploy complete! 2023-07-20T01:07:44.573 DEBUG:teuthology.parallel:result is None 2023-07-20T01:07:46.768 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:07:47.014 WARNING:teuthology.provision.fog.smithi162:timed out 2023-07-20T01:07:52.773 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:07:53.015 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:07:53.393 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-20T01:07:53.393 DEBUG:teuthology.orchestra.run.smithi162:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-20T01:07:53.674 INFO:teuthology.provision.fog.smithi162:Node is ready 2023-07-20T01:07:53.675 DEBUG:teuthology.orchestra.run.smithi162:> hostname 2023-07-20T01:07:53.692 INFO:teuthology.orchestra.run.smithi162.stdout:smithi162.front.sepia.ceph.com 2023-07-20T01:07:53.692 DEBUG:teuthology.orchestra.run.smithi162:> grep smithi162.front.sepia.ceph.com /etc/hosts 2023-07-20T01:07:53.753 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.15.162 smithi162.front.sepia.ceph.com smithi162 2023-07-20T01:07:53.753 DEBUG:teuthology.orchestra.run.smithi162:> sudo hostname smithi162 2023-07-20T01:07:53.885 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i -e 's/smithi162.front.sepia.ceph.com/smithi162/g' /etc/hosts 2023-07-20T01:07:53.913 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i -e 's/172.21.15.162/172.21.15.162/g' /etc/hosts 2023-07-20T01:07:53.983 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i -e 's/smithi162.front.sepia.ceph.com/smithi162/g' /etc/hostname 2023-07-20T01:07:54.053 DEBUG:teuthology.orchestra.run.smithi162:> sudo hostname smithi162 2023-07-20T01:07:54.122 DEBUG:teuthology.orchestra.run.smithi162:> cat /etc/os-release 2023-07-20T01:07:54.182 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="Red Hat Enterprise Linux" 2023-07-20T01:07:54.182 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="8.6 (Ootpa)" 2023-07-20T01:07:54.182 INFO:teuthology.orchestra.run.smithi162.stdout:ID="rhel" 2023-07-20T01:07:54.182 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE="fedora" 2023-07-20T01:07:54.182 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="8.6" 2023-07-20T01:07:54.182 INFO:teuthology.orchestra.run.smithi162.stdout:PLATFORM_ID="platform:el8" 2023-07-20T01:07:54.183 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-20T01:07:54.183 INFO:teuthology.orchestra.run.smithi162.stdout:ANSI_COLOR="0;31" 2023-07-20T01:07:54.183 INFO:teuthology.orchestra.run.smithi162.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-20T01:07:54.183 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://www.redhat.com/" 2023-07-20T01:07:54.183 INFO:teuthology.orchestra.run.smithi162.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-20T01:07:54.183 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-20T01:07:54.183 INFO:teuthology.orchestra.run.smithi162.stdout: 2023-07-20T01:07:54.184 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-20T01:07:54.184 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-20T01:07:54.184 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-20T01:07:54.184 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-20T01:07:54.184 INFO:teuthology.provision.fog.smithi162:Deploy complete! 2023-07-20T01:07:54.185 DEBUG:teuthology.parallel:result is None 2023-07-20T01:07:55.824 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:08:01.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:08:04.884 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:08:10.889 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:08:13.968 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:08:19.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:08:23.024 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:08:29.031 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:08:32.112 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:08:38.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:08:41.168 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:08:47.175 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:08:50.256 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:08:56.264 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:08:59.344 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:09:05.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:09:08.400 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:09:14.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:09:17.456 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:09:23.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:09:26.516 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:09:32.521 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:09:35.600 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:09:41.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:09:44.656 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:09:50.662 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:09:53.712 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:09:59.717 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:10:02.768 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:10:08.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:10:11.856 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:10:17.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:10:20.912 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:10:26.916 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:10:29.968 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:10:35.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:10:39.024 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:10:45.030 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:10:48.080 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:10:54.085 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:10:57.136 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:11:03.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:11:06.196 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:11:12.200 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:11:15.280 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:11:21.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:11:24.340 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:11:30.347 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:11:33.424 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:11:39.428 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:11:42.480 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:11:48.482 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:11:51.536 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:11:57.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:12:00.592 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:12:06.597 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:12:09.648 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:12:15.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:12:18.704 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:12:24.707 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:12:27.760 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:12:33.764 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:12:36.816 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:12:42.820 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:12:45.872 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:12:51.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:12:54.960 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:13:00.962 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:13:04.016 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:13:10.020 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:13:13.072 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:13:19.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:13:22.164 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:13:28.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:13:31.248 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:13:37.251 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:13:40.304 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:13:46.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:13:49.360 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:13:55.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:13:58.416 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:14:04.423 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:14:07.511 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:14:13.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:14:16.592 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:14:22.596 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:14:25.651 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:14:31.656 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:14:34.736 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:14:40.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:14:43.824 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:14:49.825 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:14:52.880 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:14:58.884 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:15:01.936 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:15:07.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:15:10.992 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:15:16.996 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:15:20.048 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:15:26.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:15:29.104 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:15:35.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:15:38.160 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:15:44.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:15:47.216 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:15:53.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:15:56.272 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:16:02.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:16:05.328 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:16:11.335 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:16:14.416 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:16:20.420 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:16:23.472 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:16:29.476 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:16:32.528 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:16:38.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:16:41.584 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:16:47.588 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:16:50.644 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:16:56.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:16:59.728 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:17:05.732 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:17:08.784 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:17:14.791 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:17:17.872 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:17:23.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:17:26.928 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:17:32.931 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:17:35.984 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:17:41.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:17:45.072 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:17:51.073 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:17:54.128 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:18:00.135 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:18:03.216 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:18:09.221 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:18:12.272 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:18:18.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:18:21.328 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:18:27.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:18:30.384 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:18:36.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:18:39.440 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:18:45.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:18:48.496 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:18:54.499 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:18:57.552 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:19:03.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:19:06.640 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:19:12.647 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:19:15.728 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:19:21.732 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:19:24.784 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:19:30.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:19:33.844 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:19:39.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:19:42.928 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:19:48.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:19:51.984 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:19:57.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:20:01.040 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:20:07.047 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:20:10.128 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:20:16.135 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:20:19.216 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:20:25.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:20:28.272 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:20:34.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:20:37.328 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:20:43.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:20:46.384 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:20:52.391 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:20:55.472 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:21:01.476 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:21:04.528 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:21:10.531 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:21:13.584 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:21:19.591 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:21:22.640 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:21:28.647 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:21:31.728 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:21:37.732 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-20T01:21:40.784 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-20T01:21:40.786 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/provision/fog.py", line 276, in _wait_for_ready while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (101) after waiting for 600 seconds 2023-07-20T01:21:40.788 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-20T01:21:40.789 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-20T01:21:40.880 INFO:teuthology.nuke:Checking targets against current locks 2023-07-20T01:21:40.938 DEBUG:teuthology.nuke:shortname: smithi118 2023-07-20T01:21:40.938 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-20T01:21:40.962 DEBUG:teuthology.nuke:shortname: smithi140 2023-07-20T01:21:40.963 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-20T01:21:40.965 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi118.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-20_00:39:06-fs:workload-wip-pdonnell-testing-20230719.201220-distro-default-smithi/7344245', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-20 01:01:53.282907', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDOozFkVnZus2kxiY5zaJQyM26IltxdeKHFHdwvzV4H61H6Bep+T8JhWFYOrJkH9MM0eUM+Z5CLUzRTET2HHw9wABpJKHXHpRsDSsQER1Q4hj/9+ryt9+RBqUOuxjEqJm0ev0cHONvwMtz7r9EvLOhS43af1XTgdm9GgnTx7zkzKi51fc2NO1jThg9JTYGmgrolOpWErz/fIjHhV/V9uAvOsQupav8h9mUnO3ZokJeH2as7clH+vlnYJWzjfzQl2lEQ9/OkkE07ZSb8Oxsz2+oIhjTi6pk5XZWUJFxw06hUwq5YUGRFXYZvUWSnyJuxiR/a9aoa6z7OhqohqgUIcl77a2hmax/sOk5atqHNvCNmgA6LYqTbNS8v+aWD6L4VpPT2FSWyCfXo6Hw2S2Nvz+VCnQft7GR9ocaCMDYZA6SKeBC0GxNORuAt+rpjzOSoD3cEv6iSd0yYSY87NxoZQP+pOv2UHcsBfXRECRJ+6FN2IuQCwtaMR6omOo3FVCM6CQ8='} 2023-07-20T01:21:40.985 DEBUG:teuthology.nuke:shortname: smithi162 2023-07-20T01:21:40.986 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-20T01:21:40.990 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi140.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-20_00:39:06-fs:workload-wip-pdonnell-testing-20230719.201220-distro-default-smithi/7344245', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-20 01:01:53.280561', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNHFOYoEd7947jQBhNZzSB4F0qgLtJJOxlANkSU6SI2SJIfogCS9TD7u2oJpbJDDRgwYOQiIxhkG5ksfomyq8tjCZYsfRx9sFePJimuT3qi3DCv/8cCa5ykHA6kj2LppWFJYDBrsDxSPaFaXB0lIpPYRl++hPcfwpGO5qwyqz6UowyBIiYssDGwE3SPgzaR4VGOQh8+U6bDxxJ8nt7aN94tYJ70H4UiP0IdDhv15vezU8RPBDPip389Eq2TS8dlRI5rt0qmUDhYMPBbysUy4S6qwBuWB5J7ELfLq0gDnX0SUNG92LGc4jx0ivcP2ckN8OUp2vF/Tt/mA1W3D9JVhZaPSKwc1GbSaq2Uo2gTHeijh95RTjuYuB6wWQ/RHX4GIiEHN5raU1FahM5gCFGOTbWELeQFs8Q6sekRONf7X9rPgqrJiOt4UMQVYzMAKTuxa6Hr/Xbf2vU5ScWNrZD4EPFkcmt1DuKDDDJRuEGyINqD3goBZ6zxcRy291mfaCb1Ts='} 2023-07-20T01:21:41.011 INFO:teuthology.orchestra.console:Power off smithi118 2023-07-20T01:21:41.012 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-20T01:21:41.025 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi162.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-20_00:39:06-fs:workload-wip-pdonnell-testing-20230719.201220-distro-default-smithi/7344245', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-20 01:01:53.284693', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIG7gIe0/gdFKtHzYqQ8ZclFhkSsurFZI8Ub5ZUs4E9We'} 2023-07-20T01:21:41.033 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T01:21:41.057 INFO:teuthology.orchestra.console:Power off smithi140 2023-07-20T01:21:41.058 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-20T01:21:41.079 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T01:21:41.096 INFO:teuthology.orchestra.console:Power off smithi162 2023-07-20T01:21:41.097 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-20T01:21:41.118 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T01:21:45.068 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T01:21:45.107 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T01:21:45.144 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T01:21:49.184 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T01:21:49.218 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T01:21:49.255 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-20T01:21:49.396 INFO:teuthology.orchestra.console:Power off for smithi118 completed 2023-07-20T01:21:49.429 INFO:teuthology.orchestra.console:Power off for smithi140 completed 2023-07-20T01:21:49.465 INFO:teuthology.orchestra.console:Power off for smithi162 completed 2023-07-20T01:21:49.558 INFO:teuthology.lock.ops:unlocked: smithi118.front.sepia.ceph.com 2023-07-20T01:21:49.583 INFO:teuthology.lock.ops:unlocked: smithi140.front.sepia.ceph.com 2023-07-20T01:21:49.608 INFO:teuthology.lock.ops:unlocked: smithi162.front.sepia.ceph.com 2023-07-20T01:21:49.982 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/dispatcher/supervisor.py", line 57, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/provision/fog.py", line 276, in _wait_for_ready while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (101) after waiting for 600 seconds