2023-09-03T10:41:40.514 INFO:root:teuthology version: 0.0.1.dev192+gf9a8556 2023-09-03T10:41:40.516 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-03T10:41:41.030 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8d58d3a670>, signals=[15]) 2023-09-03T10:41:41.032 INFO:teuthology.lock.ops:Start node 'smithi064.front.sepia.ceph.com' reimaging 2023-09-03T10:41:41.032 INFO:teuthology.lock.ops:Updating [smithi064.front.sepia.ceph.com]: reset os type and version on server 2023-09-03T10:41:41.033 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server 2023-09-03T10:41:41.279 INFO:teuthology.lock.ops:Start node 'smithi140.front.sepia.ceph.com' reimaging 2023-09-03T10:41:41.279 INFO:teuthology.lock.ops:Updating [smithi140.front.sepia.ceph.com]: reset os type and version on server 2023-09-03T10:41:41.279 INFO:teuthology.lock.ops:Updating smithi140.front.sepia.ceph.com on lock server 2023-09-03T10:41:41.281 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /host {"name": "smithi064"} 2023-09-03T10:41:41.350 INFO:teuthology.lock.ops:Start node 'smithi155.front.sepia.ceph.com' reimaging 2023-09-03T10:41:41.350 INFO:teuthology.lock.ops:Updating [smithi155.front.sepia.ceph.com]: reset os type and version on server 2023-09-03T10:41:41.350 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server 2023-09-03T10:41:41.352 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /host {"name": "smithi140"} 2023-09-03T10:41:41.446 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /host {"name": "smithi155"} 2023-09-03T10:41:41.492 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-09-03T10:41:41.549 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-09-03T10:41:41.581 DEBUG:teuthology.provision.fog.smithi064:Requesting image smithi_rhel_8.6 (ID 5) 2023-09-03T10:41:41.581 DEBUG:teuthology.provision.fog.smithi064:FOG request: PUT /host/169 {"imageID": 5} 2023-09-03T10:41:41.619 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-09-03T10:41:41.653 DEBUG:teuthology.provision.fog.smithi140:Requesting image smithi_rhel_8.6 (ID 5) 2023-09-03T10:41:41.653 DEBUG:teuthology.provision.fog.smithi140:FOG request: PUT /host/245 {"imageID": 5} 2023-09-03T10:41:41.699 INFO:teuthology.provision.fog.smithi064:Scheduling deploy of rhel 8.6 2023-09-03T10:41:41.700 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-09-03T10:41:41.706 DEBUG:teuthology.provision.fog.smithi155:Requesting image smithi_rhel_8.6 (ID 5) 2023-09-03T10:41:41.706 DEBUG:teuthology.provision.fog.smithi155:FOG request: PUT /host/260 {"imageID": 5} 2023-09-03T10:41:41.720 INFO:teuthology.provision.fog.smithi140:Scheduling deploy of rhel 8.6 2023-09-03T10:41:41.722 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-03T10:41:41.775 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /tasktype {"name": "deploy"} 2023-09-03T10:41:41.822 INFO:teuthology.provision.fog.smithi155:Scheduling deploy of rhel 8.6 2023-09-03T10:41:41.822 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-09-03T10:41:41.824 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /tasktype {"name": "deploy"} 2023-09-03T10:41:41.924 DEBUG:teuthology.provision.fog.smithi064:FOG request: POST /host/169/task {"taskTypeID": 1} 2023-09-03T10:41:41.950 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /tasktype {"name": "deploy"} 2023-09-03T10:41:41.959 DEBUG:teuthology.provision.fog.smithi140:FOG request: POST /host/245/task {"taskTypeID": 1} 2023-09-03T10:41:42.014 DEBUG:teuthology.provision.fog.smithi155:FOG request: POST /host/260/task {"taskTypeID": 1} 2023-09-03T10:41:42.070 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-09-03T10:41:42.094 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-03T10:41:42.171 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-09-03T10:41:42.251 INFO:teuthology.orchestra.console.smithi140:Power off 2023-09-03T10:41:42.253 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-03T10:41:42.278 INFO:teuthology.orchestra.console.smithi064:Power off 2023-09-03T10:41:42.279 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-03T10:41:42.314 DEBUG:teuthology.orchestra.console.smithi140:power off output: Chassis Power Control: Down/Off 2023-09-03T10:41:42.327 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-03T10:41:42.351 DEBUG:teuthology.orchestra.console.smithi064:power off output: Chassis Power Control: Down/Off 2023-09-03T10:41:42.352 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-03T10:41:42.404 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on 2023-09-03T10:41:42.505 INFO:teuthology.orchestra.console.smithi155:Power off 2023-09-03T10:41:42.506 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-03T10:41:42.596 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2023-09-03T10:41:42.630 DEBUG:teuthology.orchestra.console.smithi155:power off output: Chassis Power Control: Down/Off 2023-09-03T10:41:42.631 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-03T10:41:42.700 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is on 2023-09-03T10:41:46.414 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-03T10:41:46.541 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on 2023-09-03T10:41:46.629 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-03T10:41:46.714 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-03T10:41:46.766 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2023-09-03T10:41:46.825 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is on 2023-09-03T10:41:50.548 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-03T10:41:50.691 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off 2023-09-03T10:41:50.768 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-03T10:41:50.805 INFO:teuthology.orchestra.console.smithi140:Power off completed 2023-09-03T10:41:50.829 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-03T10:41:50.884 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2023-09-03T10:41:50.914 INFO:teuthology.orchestra.console.smithi140:Power on 2023-09-03T10:41:50.915 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-03T10:41:50.961 DEBUG:teuthology.orchestra.console.smithi140:power on output: Chassis Power Control: Up/On 2023-09-03T10:41:50.963 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-03T10:41:50.987 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off 2023-09-03T10:41:51.004 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off 2023-09-03T10:41:51.096 INFO:teuthology.orchestra.console.smithi155:Power off completed 2023-09-03T10:41:51.197 INFO:teuthology.orchestra.console.smithi155:Power on 2023-09-03T10:41:51.198 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-03T10:41:51.233 DEBUG:teuthology.orchestra.console.smithi155:power on output: Chassis Power Control: Up/On 2023-09-03T10:41:51.233 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-03T10:41:51.269 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off 2023-09-03T10:41:54.890 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-03T10:41:54.999 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off 2023-09-03T10:41:55.005 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-03T10:41:55.102 INFO:teuthology.orchestra.console.smithi064:Power off completed 2023-09-03T10:41:55.120 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off 2023-09-03T10:41:55.206 INFO:teuthology.orchestra.console.smithi064:Power on 2023-09-03T10:41:55.206 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-03T10:41:55.242 DEBUG:teuthology.orchestra.console.smithi064:power on output: Chassis Power Control: Up/On 2023-09-03T10:41:55.243 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-03T10:41:55.273 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-03T10:41:55.291 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off 2023-09-03T10:41:55.397 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off 2023-09-03T10:41:59.126 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-03T10:41:59.251 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on 2023-09-03T10:41:59.295 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-03T10:41:59.353 INFO:teuthology.orchestra.console.smithi140:Power on completed 2023-09-03T10:41:59.398 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-03T10:41:59.417 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off 2023-09-03T10:41:59.461 INFO:teuthology.provision.fog.smithi140:Waiting for deploy to finish 2023-09-03T10:41:59.462 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-03T10:41:59.510 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is on 2023-09-03T10:41:59.617 INFO:teuthology.orchestra.console.smithi155:Power on completed 2023-09-03T10:41:59.720 INFO:teuthology.provision.fog.smithi155:Waiting for deploy to finish 2023-09-03T10:41:59.720 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-09-03T10:42:03.424 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-03T10:42:03.542 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2023-09-03T10:42:03.643 INFO:teuthology.orchestra.console.smithi064:Power on completed 2023-09-03T10:42:03.744 INFO:teuthology.provision.fog.smithi064:Waiting for deploy to finish 2023-09-03T10:42:03.744 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-09-03T10:42:14.550 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-03T10:42:14.807 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-09-03T10:42:18.831 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-09-03T10:42:29.642 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-03T10:42:29.911 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-09-03T10:42:33.918 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-09-03T10:42:44.734 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-03T10:42:45.005 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-09-03T10:42:49.010 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-09-03T10:42:59.824 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-03T10:43:00.070 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-09-03T10:43:04.090 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-09-03T10:43:14.914 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-03T10:43:15.134 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-09-03T10:43:19.196 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-09-03T10:43:29.988 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-03T10:43:30.204 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-09-03T10:43:34.282 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-09-03T10:43:45.075 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-03T10:43:45.272 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-09-03T10:43:49.351 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-09-03T10:44:00.170 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-03T10:44:00.345 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-09-03T10:44:04.429 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-09-03T10:44:15.261 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-03T10:44:15.422 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-09-03T10:44:19.506 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-09-03T10:44:30.342 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-03T10:44:30.489 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-09-03T10:44:34.574 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-09-03T10:44:45.408 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-09-03T10:44:45.477 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:44:45.556 DEBUG:teuthology.provision.fog.smithi155:FOG request: GET /task/active None 2023-09-03T10:44:45.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:44:48.543 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:44:48.698 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-09-03T10:44:49.640 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-09-03T10:44:49.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:44:52.762 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-09-03T10:44:54.546 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:44:54.707 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:44:57.628 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:44:57.786 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-09-03T10:44:58.765 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:45:01.818 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-09-03T10:45:03.631 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:45:03.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:45:06.719 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:45:06.842 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-09-03T10:45:07.820 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:45:10.875 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-09-03T10:45:12.722 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:45:12.845 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:45:15.806 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:45:15.904 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-09-03T10:45:16.885 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:45:20.032 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-09-03T10:45:21.809 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:45:21.906 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:45:24.890 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:45:24.986 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-09-03T10:45:26.034 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:45:29.114 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-09-03T10:45:30.893 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:45:30.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:45:33.946 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:45:34.042 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-09-03T10:45:35.116 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:45:38.170 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-09-03T10:45:39.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:45:40.047 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:45:43.098 WARNING:teuthology.provision.fog.smithi155:[Errno None] Unable to connect to port 22 on 172.21.15.155 2023-09-03T10:45:44.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:45:49.105 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:46:02.650 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-09-03T10:46:08.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:46:11.739 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-09-03T10:46:17.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:46:20.362 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-03T10:46:20.363 DEBUG:teuthology.orchestra.run.smithi064:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-03T10:46:20.655 INFO:teuthology.provision.fog.smithi064:Node is ready 2023-09-03T10:46:20.655 DEBUG:teuthology.orchestra.run.smithi064:> hostname 2023-09-03T10:46:20.672 INFO:teuthology.orchestra.run.smithi064.stdout:smithi022 2023-09-03T10:46:20.672 DEBUG:teuthology.orchestra.run.smithi064:> grep smithi022 /etc/hosts 2023-09-03T10:46:20.729 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2023-09-03T10:46:20.730 DEBUG:teuthology.orchestra.run.smithi064:> sudo hostname smithi064 2023-09-03T10:46:20.830 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/smithi022/smithi064/g' /etc/hosts 2023-09-03T10:46:20.858 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/172.21.15.22/172.21.15.64/g' /etc/hosts 2023-09-03T10:46:20.927 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/smithi022/smithi064/g' /etc/hostname 2023-09-03T10:46:20.996 DEBUG:teuthology.orchestra.run.smithi064:> sudo hostname smithi064 2023-09-03T10:46:21.064 DEBUG:teuthology.orchestra.run.smithi064:> cat /etc/os-release 2023-09-03T10:46:21.123 INFO:teuthology.orchestra.run.smithi064.stdout:NAME="Red Hat Enterprise Linux" 2023-09-03T10:46:21.123 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION="8.6 (Ootpa)" 2023-09-03T10:46:21.123 INFO:teuthology.orchestra.run.smithi064.stdout:ID="rhel" 2023-09-03T10:46:21.124 INFO:teuthology.orchestra.run.smithi064.stdout:ID_LIKE="fedora" 2023-09-03T10:46:21.127 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_ID="8.6" 2023-09-03T10:46:21.127 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM_ID="platform:el8" 2023-09-03T10:46:21.127 INFO:teuthology.orchestra.run.smithi064.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-03T10:46:21.128 INFO:teuthology.orchestra.run.smithi064.stdout:ANSI_COLOR="0;31" 2023-09-03T10:46:21.128 INFO:teuthology.orchestra.run.smithi064.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-03T10:46:21.128 INFO:teuthology.orchestra.run.smithi064.stdout:HOME_URL="https://www.redhat.com/" 2023-09-03T10:46:21.128 INFO:teuthology.orchestra.run.smithi064.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-03T10:46:21.128 INFO:teuthology.orchestra.run.smithi064.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-03T10:46:21.129 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-09-03T10:46:21.129 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-03T10:46:21.129 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-03T10:46:21.129 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-03T10:46:21.129 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-03T10:46:21.130 INFO:teuthology.provision.fog.smithi064:Deploy complete! 2023-09-03T10:46:21.131 DEBUG:teuthology.parallel:result is None 2023-09-03T10:46:39.970 WARNING:teuthology.provision.fog.smithi140:timed out 2023-09-03T10:46:45.978 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:46:49.053 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:46:49.109 WARNING:teuthology.provision.fog.smithi155:timed out 2023-09-03T10:46:55.060 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:46:55.111 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:46:55.471 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-03T10:46:55.472 DEBUG:teuthology.orchestra.run.smithi155:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-03T10:46:55.742 INFO:teuthology.provision.fog.smithi155:Node is ready 2023-09-03T10:46:55.742 DEBUG:teuthology.orchestra.run.smithi155:> hostname 2023-09-03T10:46:55.760 INFO:teuthology.orchestra.run.smithi155.stdout:smithi155 2023-09-03T10:46:55.761 DEBUG:teuthology.orchestra.run.smithi155:> grep smithi155 /etc/hosts 2023-09-03T10:46:55.818 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155 smithi155.front.sepia.ceph.com smithi155 2023-09-03T10:46:55.819 DEBUG:teuthology.orchestra.run.smithi155:> sudo hostname smithi155 2023-09-03T10:46:55.960 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i -e 's/smithi155/smithi155/g' /etc/hosts 2023-09-03T10:46:55.989 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i -e 's/172.21.15.155/172.21.15.155/g' /etc/hosts 2023-09-03T10:46:56.057 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i -e 's/smithi155/smithi155/g' /etc/hostname 2023-09-03T10:46:56.124 DEBUG:teuthology.orchestra.run.smithi155:> sudo hostname smithi155 2023-09-03T10:46:56.190 DEBUG:teuthology.orchestra.run.smithi155:> cat /etc/os-release 2023-09-03T10:46:56.247 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="Red Hat Enterprise Linux" 2023-09-03T10:46:56.247 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="8.6 (Ootpa)" 2023-09-03T10:46:56.247 INFO:teuthology.orchestra.run.smithi155.stdout:ID="rhel" 2023-09-03T10:46:56.247 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE="fedora" 2023-09-03T10:46:56.248 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="8.6" 2023-09-03T10:46:56.248 INFO:teuthology.orchestra.run.smithi155.stdout:PLATFORM_ID="platform:el8" 2023-09-03T10:46:56.248 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-03T10:46:56.248 INFO:teuthology.orchestra.run.smithi155.stdout:ANSI_COLOR="0;31" 2023-09-03T10:46:56.248 INFO:teuthology.orchestra.run.smithi155.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-03T10:46:56.249 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://www.redhat.com/" 2023-09-03T10:46:56.249 INFO:teuthology.orchestra.run.smithi155.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-03T10:46:56.249 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-03T10:46:56.249 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-09-03T10:46:56.249 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-03T10:46:56.250 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-03T10:46:56.250 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-03T10:46:56.250 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-03T10:46:56.250 INFO:teuthology.provision.fog.smithi155:Deploy complete! 2023-09-03T10:46:56.251 DEBUG:teuthology.parallel:result is None 2023-09-03T10:46:58.138 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:47:04.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:47:07.198 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:47:13.202 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:47:16.286 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:47:22.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:47:25.370 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:47:31.378 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:47:34.458 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:47:40.463 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:47:43.514 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:47:49.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:47:52.571 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:47:58.579 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:48:01.658 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:48:07.662 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:48:10.718 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:48:16.723 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:48:19.806 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:48:25.810 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:48:28.892 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:48:34.898 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:48:37.982 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:48:43.986 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:48:47.066 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:48:53.073 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:48:56.154 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:49:02.161 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:49:05.242 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:49:11.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:49:14.302 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:49:20.306 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:49:23.386 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:49:29.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:49:32.442 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:49:38.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:49:41.498 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:49:47.502 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:49:50.558 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:49:56.562 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:49:59.642 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:50:05.647 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:50:08.702 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:50:14.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:50:17.786 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:50:23.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:50:26.842 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:50:32.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:50:35.898 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:50:41.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:50:44.954 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:50:50.958 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:50:54.010 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:51:00.017 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:51:03.102 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:51:09.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:51:12.186 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:51:18.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:51:21.242 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:51:27.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:51:30.298 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:51:36.303 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:51:39.354 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:51:45.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:51:48.410 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:51:54.416 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:51:57.501 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:52:03.506 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:52:06.586 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:52:12.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:52:15.674 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:52:21.678 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:52:24.730 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:52:30.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:52:33.818 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:52:39.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:52:42.878 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:52:48.882 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:52:51.962 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:52:57.969 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:53:01.054 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:53:07.058 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:53:10.138 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:53:16.146 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:53:19.230 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:53:25.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:53:28.314 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:53:34.321 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:53:37.402 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:53:43.409 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:53:46.494 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:53:52.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:53:55.578 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:54:01.585 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:54:04.670 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:54:10.677 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:54:13.754 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:54:19.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:54:22.810 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:54:28.812 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:54:31.870 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:54:37.877 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:54:40.954 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:54:46.958 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:54:50.010 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:54:56.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:54:59.070 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:55:05.077 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:55:08.154 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:55:14.161 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:55:17.242 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:55:23.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:55:26.298 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:55:32.302 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:55:35.354 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:55:41.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:55:44.410 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:55:50.416 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:55:53.502 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:55:59.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:56:02.586 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:56:08.590 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:56:11.642 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:56:17.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:56:20.698 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:56:26.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:56:29.754 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:56:35.759 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:56:38.810 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:56:44.817 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:56:47.898 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:56:53.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:56:56.954 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:57:02.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:57:06.010 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:57:12.017 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:57:15.098 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:57:21.102 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:57:24.154 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:57:30.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:57:33.210 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:57:39.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:57:42.266 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:57:48.271 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:57:51.322 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:57:57.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:58:00.378 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:58:06.383 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:58:09.438 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:58:15.445 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:58:18.522 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:58:24.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:58:27.610 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:58:33.617 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:58:36.698 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:58:42.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:58:45.758 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:58:51.760 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:58:54.846 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:59:00.850 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:59:03.934 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:59:09.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:59:13.018 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:59:19.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:59:22.074 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:59:28.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:59:31.130 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:59:37.137 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:59:40.218 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:59:46.221 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:59:49.274 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T10:59:55.277 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T10:59:58.334 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T11:00:04.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T11:00:07.423 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T11:00:13.430 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T11:00:16.506 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T11:00:22.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T11:00:25.566 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T11:00:31.570 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T11:00:34.654 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T11:00:40.659 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-03T11:00:43.738 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-09-03T11:00:43.740 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/provision/fog.py", line 276, in _wait_for_ready while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (101) after waiting for 600 seconds 2023-09-03T11:00:43.740 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-03T11:00:43.887 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=eb8199079d9247de9c87bf6ef1f4d5c9 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/provision/fog.py", line 276, in _wait_for_ready while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (101) after waiting for 600 seconds 2023-09-03T11:00:43.890 INFO:teuthology.nuke:Checking targets against current locks 2023-09-03T11:00:43.963 DEBUG:teuthology.nuke:shortname: smithi064 2023-09-03T11:00:43.964 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-03T11:00:43.984 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi064.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dis-2023-09-03_10:29:06-rbd-wip-dis-testing-distro-default-smithi/7387570', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-03 10:41:37.412698', 'locked_by': 'scheduled_dis@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCUF91sUgTfQ1/cU0tU6HncnrJXJzljWinaic+j2gzUC97qF3T9u4e2Z1Fbeoc+QU4b2L9oWIttqsE6+cKaa28rIXyrVKHRHqfA0mG/xbuEBRJDPgwmD8muY0OXWqUeqQVlCh+3UGKphRatsV0miCYAO69uYND+qLhqFeRtMzN/QRUK9RQn4JXql0IhUvb/LFemg2wDpPPTw+d97ahZ+MucBgYPzFWZ5wv3v+yiHQ2N2/zvzLfNizIV+JxAoD7H/M1a7BitQI8FZIzmPY5KQA3eXOiTyMYSfbA4MfTXHNxMcXAx4CZ8RQJXJnyoxFVCMorMf4VAMwJC87uZDSjy3xTw3dXBwUaLXwJaJujgY9LOLp67FLRgJBOjVCkffBN+X3cXXWVbS8Uur6LBcKEnh6KwroeROD4q0VJV1Ds7iwQtjE4uNQm2MQNqcwaAKCeM1vp39usdTskPqDMd+EFGTc8cpSVaPLAnyq3Q9UiEuZq4f+uiL5dCNmX8/Ma672WgJz0='} 2023-09-03T11:00:43.988 DEBUG:teuthology.nuke:shortname: smithi140 2023-09-03T11:00:43.988 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-03T11:00:44.003 DEBUG:teuthology.nuke:shortname: smithi155 2023-09-03T11:00:44.003 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-03T11:00:44.006 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi140.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dis-2023-09-03_10:29:06-rbd-wip-dis-testing-distro-default-smithi/7387570', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-03 10:41:37.409888', 'locked_by': 'scheduled_dis@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD+NetyGcam9Ag7UBXgkTBflv74vsiyTZx0WD+WLieIZf3F0T1Pui6Ci7E9YxkphuP1fjMSE8Qvp1fsC+Kn7p83vNGeucStPupshm83grcGCAAIlraXctWdjAQxYCgAxTueitLq8Lyvl5uZ8+w8epCa3AruVNjFNt6aYh6rmbFzTDxiOTyIkZPDmZGmfW1kJ7VtGkNtkwQW+m3nKGqVk+oy3yzci37uIrXgaXyE6yAcTtSepAcOoifzFm4EjX3Ekc3Km50wKNm29LamGrPQXLO8ti8o2A4NcWVfHdMNGqR5WGp3TWA3iGHfYzt0q+AGb4qWNeiuXimyitMkyz/joMBywIf39JDDVHk7AS+zN48wgNde03Zhhcl/9r6aKywM1+nHxYgCqnPJNTEpYzjxjKu3AZnLy5s4FnW0PAuOpPw9PJWp1ed8qgRdLC1r5YRDgibC45d0qllnpS9+XukkzBP+GfEH6Zy59I1nn/hhGQSSFq58IwA71e5ZokhTlTClJMM='} 2023-09-03T11:00:44.028 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi155.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dis-2023-09-03_10:29:06-rbd-wip-dis-testing-distro-default-smithi/7387570', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-03 10:41:37.411620', 'locked_by': 'scheduled_dis@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMc+3J0YVFD+SCsEqyjTEhlWtZeKGgYDup/58/Ccn13Uy6sKaCo3NuaF+gu9zw1TxG/zSvH4w4PmTqpBOfTSZY021JKnbELCmkP8DZZ00AmpsWHRkQhZ2mdVL57IwVX7gzlfgIedWbKOZ0j/AIN71II1789cLOuSOogZri7shaa9Zp+Fq3849bOduTCcBT3KicigtQ7NLj1E0dl2t9gokZBwQy2VQAVkr4ruL55sZ/noduXs4Ie1gjnhD/EyKm799Vu6cfFidLkQpfOFCYSnNcJpo8qZaKsPCnr8P80smAoitLB2KtSa2vQVYom3+/JXgJXbR7S5LNieKY6hrQDaz8KRnGGUzG9CWSUuSawPOct19f6KSQpoHzR1kodLofeeDXPQPPLvdkTKzHpuas7gGB41HmgZmV5oHKK3emQ+kdymC/NRXEokKdm5rpZ8sC24fSIY3+eFxzPhlntW1hHNLf1mVNENZMmMhc98nTlSPZYSU1UJTIygA6L9tGpKfcnsU='} 2023-09-03T11:00:44.037 INFO:teuthology.orchestra.console.smithi064:Power off 2023-09-03T11:00:44.038 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-03T11:00:44.059 DEBUG:teuthology.orchestra.console.smithi064:power off output: Chassis Power Control: Down/Off 2023-09-03T11:00:44.059 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-03T11:00:44.077 INFO:teuthology.orchestra.console.smithi140:Power off 2023-09-03T11:00:44.078 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-03T11:00:44.086 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2023-09-03T11:00:44.098 DEBUG:teuthology.orchestra.console.smithi140:power off output: Chassis Power Control: Down/Off 2023-09-03T11:00:44.098 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-03T11:00:44.111 INFO:teuthology.orchestra.console.smithi155:Power off 2023-09-03T11:00:44.112 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-03T11:00:44.121 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on 2023-09-03T11:00:44.132 DEBUG:teuthology.orchestra.console.smithi155:power off output: Chassis Power Control: Down/Off 2023-09-03T11:00:44.132 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-03T11:00:44.154 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is on 2023-09-03T11:00:48.091 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-03T11:00:48.123 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-03T11:00:48.156 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-03T11:00:48.200 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2023-09-03T11:00:48.231 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on 2023-09-03T11:00:48.264 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is on 2023-09-03T11:00:52.202 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-03T11:00:52.232 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-03T11:00:52.265 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-03T11:00:52.310 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2023-09-03T11:00:52.341 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off 2023-09-03T11:00:52.374 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is on 2023-09-03T11:00:52.441 INFO:teuthology.orchestra.console.smithi140:Power off completed 2023-09-03T11:00:52.588 INFO:teuthology.lock.ops:unlocked: smithi140.front.sepia.ceph.com 2023-09-03T11:00:56.314 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-03T11:00:56.375 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-03T11:00:56.427 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off 2023-09-03T11:00:56.485 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off 2023-09-03T11:00:56.528 INFO:teuthology.orchestra.console.smithi064:Power off completed 2023-09-03T11:00:56.587 INFO:teuthology.orchestra.console.smithi155:Power off completed 2023-09-03T11:00:56.680 INFO:teuthology.lock.ops:unlocked: smithi064.front.sepia.ceph.com 2023-09-03T11:00:56.738 INFO:teuthology.lock.ops:unlocked: smithi155.front.sepia.ceph.com 2023-09-03T11:00:57.115 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/dispatcher/supervisor.py", line 58, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/provision/fog.py", line 276, in _wait_for_ready while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (101) after waiting for 600 seconds