2023-10-29T15:59:12.967 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-10-29T15:59:12.968 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-29T15:59:13.117 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f605cc97670>, signals=[15]) 2023-10-29T15:59:13.119 INFO:teuthology.lock.ops:Start node 'smithi007.front.sepia.ceph.com' reimaging 2023-10-29T15:59:13.119 INFO:teuthology.lock.ops:Updating [smithi007.front.sepia.ceph.com]: reset os type and version on server 2023-10-29T15:59:13.119 INFO:teuthology.lock.ops:Updating smithi007.front.sepia.ceph.com on lock server 2023-10-29T15:59:13.137 INFO:teuthology.lock.ops:Start node 'smithi183.front.sepia.ceph.com' reimaging 2023-10-29T15:59:13.137 INFO:teuthology.lock.ops:Updating [smithi183.front.sepia.ceph.com]: reset os type and version on server 2023-10-29T15:59:13.138 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server 2023-10-29T15:59:13.139 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /host {"name": "smithi007"} 2023-10-29T15:59:13.162 INFO:teuthology.lock.ops:Start node 'smithi195.front.sepia.ceph.com' reimaging 2023-10-29T15:59:13.162 INFO:teuthology.lock.ops:Updating [smithi195.front.sepia.ceph.com]: reset os type and version on server 2023-10-29T15:59:13.162 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2023-10-29T15:59:13.164 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /host {"name": "smithi183"} 2023-10-29T15:59:13.186 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /host {"name": "smithi195"} 2023-10-29T15:59:13.210 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-10-29T15:59:13.234 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-10-29T15:59:13.255 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-10-29T15:59:13.258 DEBUG:teuthology.provision.fog.smithi007:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-10-29T15:59:13.258 DEBUG:teuthology.provision.fog.smithi007:FOG request: PUT /host/113 {"imageID": 6} 2023-10-29T15:59:13.284 DEBUG:teuthology.provision.fog.smithi183:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-10-29T15:59:13.285 DEBUG:teuthology.provision.fog.smithi183:FOG request: PUT /host/288 {"imageID": 6} 2023-10-29T15:59:13.304 DEBUG:teuthology.provision.fog.smithi195:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-10-29T15:59:13.304 DEBUG:teuthology.provision.fog.smithi195:FOG request: PUT /host/300 {"imageID": 6} 2023-10-29T15:59:13.307 INFO:teuthology.provision.fog.smithi007:Scheduling deploy of ubuntu 22.04 2023-10-29T15:59:13.307 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-10-29T15:59:13.335 INFO:teuthology.provision.fog.smithi183:Scheduling deploy of ubuntu 22.04 2023-10-29T15:59:13.335 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-29T15:59:13.359 INFO:teuthology.provision.fog.smithi195:Scheduling deploy of ubuntu 22.04 2023-10-29T15:59:13.360 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-10-29T15:59:13.610 DEBUG:teuthology.provision.fog.smithi183:Canceling deploy task with ID 572387 2023-10-29T15:59:13.610 DEBUG:teuthology.provision.fog.smithi183:FOG request: DELETE /task/cancel {"id": 572387} 2023-10-29T15:59:13.617 DEBUG:teuthology.provision.fog.smithi007:Canceling deploy task with ID 572385 2023-10-29T15:59:13.617 DEBUG:teuthology.provision.fog.smithi007:FOG request: DELETE /task/cancel {"id": 572385} 2023-10-29T15:59:13.625 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /tasktype {"name": "deploy"} 2023-10-29T15:59:13.685 DEBUG:teuthology.provision.fog.smithi195:FOG request: POST /host/300/task {"taskTypeID": 1} 2023-10-29T15:59:13.689 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /tasktype {"name": "deploy"} 2023-10-29T15:59:13.690 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /tasktype {"name": "deploy"} 2023-10-29T15:59:13.732 DEBUG:teuthology.provision.fog.smithi183:FOG request: POST /host/288/task {"taskTypeID": 1} 2023-10-29T15:59:13.735 DEBUG:teuthology.provision.fog.smithi007:FOG request: POST /host/113/task {"taskTypeID": 1} 2023-10-29T15:59:13.755 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-10-29T15:59:13.787 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-29T15:59:13.797 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-10-29T15:59:14.108 INFO:teuthology.orchestra.console.smithi183:Power off 2023-10-29T15:59:14.109 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-29T15:59:14.120 INFO:teuthology.orchestra.console.smithi195:Power off 2023-10-29T15:59:14.121 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-29T15:59:14.131 DEBUG:teuthology.orchestra.console.smithi183:power off output: Chassis Power Control: Down/Off 2023-10-29T15:59:14.132 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-29T15:59:14.140 DEBUG:teuthology.orchestra.console.smithi195:power off output: Chassis Power Control: Down/Off 2023-10-29T15:59:14.141 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-29T15:59:14.152 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off 2023-10-29T15:59:14.161 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2023-10-29T15:59:14.188 INFO:teuthology.orchestra.console.smithi007:Power off 2023-10-29T15:59:14.188 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-29T15:59:14.209 DEBUG:teuthology.orchestra.console.smithi007:power off output: Chassis Power Control: Down/Off 2023-10-29T15:59:14.210 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-29T15:59:14.236 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is off 2023-10-29T15:59:14.254 INFO:teuthology.orchestra.console.smithi183:Power off completed 2023-10-29T15:59:14.262 INFO:teuthology.orchestra.console.smithi195:Power off completed 2023-10-29T15:59:14.337 INFO:teuthology.orchestra.console.smithi007:Power off completed 2023-10-29T15:59:14.355 INFO:teuthology.orchestra.console.smithi183:Power on 2023-10-29T15:59:14.355 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-29T15:59:14.364 INFO:teuthology.orchestra.console.smithi195:Power on 2023-10-29T15:59:14.364 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-29T15:59:14.376 DEBUG:teuthology.orchestra.console.smithi183:power on output: Chassis Power Control: Up/On 2023-10-29T15:59:14.376 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-29T15:59:14.385 DEBUG:teuthology.orchestra.console.smithi195:power on output: Chassis Power Control: Up/On 2023-10-29T15:59:14.386 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-29T15:59:14.397 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off 2023-10-29T15:59:14.405 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2023-10-29T15:59:14.438 INFO:teuthology.orchestra.console.smithi007:Power on 2023-10-29T15:59:14.439 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-29T15:59:14.460 DEBUG:teuthology.orchestra.console.smithi007:power on output: Chassis Power Control: Up/On 2023-10-29T15:59:14.460 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-29T15:59:14.483 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is off 2023-10-29T15:59:18.402 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-29T15:59:18.409 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-29T15:59:18.485 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-29T15:59:18.512 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off 2023-10-29T15:59:18.518 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2023-10-29T15:59:18.594 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is off 2023-10-29T15:59:22.515 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-29T15:59:22.524 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-29T15:59:22.595 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-29T15:59:22.626 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on 2023-10-29T15:59:22.632 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2023-10-29T15:59:22.703 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is on 2023-10-29T15:59:22.728 INFO:teuthology.orchestra.console.smithi183:Power on completed 2023-10-29T15:59:22.733 INFO:teuthology.orchestra.console.smithi195:Power on completed 2023-10-29T15:59:22.805 INFO:teuthology.orchestra.console.smithi007:Power on completed 2023-10-29T15:59:22.828 INFO:teuthology.provision.fog.smithi183:Waiting for deploy to finish 2023-10-29T15:59:22.829 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-29T15:59:22.834 INFO:teuthology.provision.fog.smithi195:Waiting for deploy to finish 2023-10-29T15:59:22.834 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-10-29T15:59:22.906 INFO:teuthology.provision.fog.smithi007:Waiting for deploy to finish 2023-10-29T15:59:22.907 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-10-29T15:59:38.109 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-10-29T15:59:38.111 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-29T15:59:38.112 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-10-29T15:59:53.385 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-10-29T15:59:53.386 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-10-29T15:59:53.396 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-29T16:00:08.642 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-10-29T16:00:08.643 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-10-29T16:00:08.644 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-29T16:00:23.906 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-29T16:00:23.907 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-10-29T16:00:23.908 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-10-29T16:00:39.147 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-10-29T16:00:39.149 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-10-29T16:00:39.149 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-29T16:00:54.362 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-10-29T16:00:54.364 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-29T16:00:54.365 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-10-29T16:01:09.560 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-10-29T16:01:09.562 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-29T16:01:09.563 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-10-29T16:01:24.739 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-10-29T16:01:24.741 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-29T16:01:24.742 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-10-29T16:01:39.905 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-29T16:01:39.907 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-10-29T16:01:39.908 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-10-29T16:01:55.066 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-10-29T16:01:55.068 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-10-29T16:01:55.069 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-29T16:02:10.219 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-10-29T16:02:10.220 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-10-29T16:02:10.221 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-29T16:02:25.366 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-10-29T16:02:25.368 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-10-29T16:02:25.369 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-29T16:02:40.498 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-10-29T16:02:40.499 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-10-29T16:02:40.500 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-29T16:02:55.619 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-10-29T16:02:55.621 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-10-29T16:02:55.622 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-29T16:03:10.740 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-10-29T16:03:10.742 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-29T16:03:10.743 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-10-29T16:03:25.846 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-10-29T16:03:25.847 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-10-29T16:03:25.848 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-29T16:03:40.922 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-10-29T16:03:40.925 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-29T16:03:40.926 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-10-29T16:03:56.002 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-10-29T16:03:56.004 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-29T16:03:56.005 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-10-29T16:04:11.071 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-10-29T16:04:11.075 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-10-29T16:04:11.079 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-29T16:04:11.128 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-29T16:04:11.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-29T16:04:11.425 ERROR:teuthology.orchestra.connection:Error authenticating with smithi195.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-10-29T16:04:26.127 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-10-29T16:04:26.184 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-29T16:04:29.690 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-10-29T16:04:35.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-29T16:04:38.746 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-10-29T16:04:44.538 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7 2023-10-29T16:04:44.748 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-29T16:04:47.802 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-10-29T16:04:50.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-29T16:04:53.598 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7 2023-10-29T16:04:53.804 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-29T16:04:56.858 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-10-29T16:04:59.600 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-29T16:05:02.682 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7 2023-10-29T16:05:02.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-29T16:05:08.684 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-29T16:05:11.738 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7 2023-10-29T16:05:15.430 WARNING:teuthology.provision.fog.smithi195:timed out 2023-10-29T16:05:17.741 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-29T16:05:20.794 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7 2023-10-29T16:05:21.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-29T16:05:26.796 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-29T16:05:29.850 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7 2023-10-29T16:05:35.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-29T16:05:38.906 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7 2023-10-29T16:05:39.834 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-10-29T16:05:44.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-29T16:05:45.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-29T16:05:47.866 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-10-29T16:05:47.962 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7 2023-10-29T16:05:53.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-29T16:05:53.870 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-10-29T16:05:53.963 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-29T16:05:57.018 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7 2023-10-29T16:05:59.872 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-29T16:05:59.874 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-10-29T16:06:02.863 WARNING:teuthology.provision.fog.smithi183:timed out 2023-10-29T16:06:03.020 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-29T16:06:05.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-29T16:06:05.878 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-10-29T16:06:06.078 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7 2023-10-29T16:06:08.864 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-29T16:06:09.146 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-29T16:06:09.147 DEBUG:teuthology.orchestra.run.smithi183:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-29T16:06:09.613 INFO:teuthology.provision.fog.smithi183:Node is ready 2023-10-29T16:06:09.613 DEBUG:teuthology.orchestra.run.smithi183:> hostname 2023-10-29T16:06:09.660 INFO:teuthology.orchestra.run.smithi183.stdout:smithi183.front.sepia.ceph.com 2023-10-29T16:06:09.660 DEBUG:teuthology.orchestra.run.smithi183:> grep smithi183.front.sepia.ceph.com /etc/hosts 2023-10-29T16:06:09.709 INFO:teuthology.orchestra.run.smithi183.stdout:172.21.15.183 smithi183.front.sepia.ceph.com smithi183 2023-10-29T16:06:09.710 DEBUG:teuthology.orchestra.run.smithi183:> sudo hostname smithi183 2023-10-29T16:06:09.832 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/smithi183.front.sepia.ceph.com/smithi183/g' /etc/hosts 2023-10-29T16:06:09.845 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/172.21.15.183/172.21.15.183/g' /etc/hosts 2023-10-29T16:06:09.900 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/smithi183.front.sepia.ceph.com/smithi183/g' /etc/hostname 2023-10-29T16:06:09.957 DEBUG:teuthology.orchestra.run.smithi183:> sudo hostname smithi183 2023-10-29T16:06:10.012 DEBUG:teuthology.orchestra.run.smithi183:> cat /etc/os-release 2023-10-29T16:06:10.064 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-10-29T16:06:10.064 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="Ubuntu" 2023-10-29T16:06:10.065 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="22.04" 2023-10-29T16:06:10.065 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-10-29T16:06:10.065 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_CODENAME=jammy 2023-10-29T16:06:10.065 INFO:teuthology.orchestra.run.smithi183.stdout:ID=ubuntu 2023-10-29T16:06:10.066 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE=debian 2023-10-29T16:06:10.066 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-29T16:06:10.066 INFO:teuthology.orchestra.run.smithi183.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-29T16:06:10.066 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-29T16:06:10.066 INFO:teuthology.orchestra.run.smithi183.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-29T16:06:10.067 INFO:teuthology.orchestra.run.smithi183.stdout:UBUNTU_CODENAME=jammy 2023-10-29T16:06:10.067 INFO:teuthology.provision.fog.smithi183:Deploy complete! 2023-10-29T16:06:10.069 DEBUG:teuthology.parallel:result is None 2023-10-29T16:06:11.880 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-29T16:06:11.882 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-10-29T16:06:12.081 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-29T16:06:15.162 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7 2023-10-29T16:06:17.884 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-29T16:06:17.960 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-29T16:06:17.960 DEBUG:teuthology.orchestra.run.smithi195:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-29T16:06:18.062 INFO:teuthology.provision.fog.smithi195:Node is ready 2023-10-29T16:06:18.063 DEBUG:teuthology.orchestra.run.smithi195:> hostname 2023-10-29T16:06:18.109 INFO:teuthology.orchestra.run.smithi195.stdout:smithi195 2023-10-29T16:06:18.109 DEBUG:teuthology.orchestra.run.smithi195:> grep smithi195 /etc/hosts 2023-10-29T16:06:18.157 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.15.195 smithi195 smithi195 2023-10-29T16:06:18.158 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname smithi195 2023-10-29T16:06:18.213 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/smithi195/smithi195/g' /etc/hosts 2023-10-29T16:06:18.270 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/172.21.15.195/172.21.15.195/g' /etc/hosts 2023-10-29T16:06:18.324 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/smithi195/smithi195/g' /etc/hostname 2023-10-29T16:06:18.376 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname smithi195 2023-10-29T16:06:18.431 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2023-10-29T16:06:18.477 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-10-29T16:06:18.477 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="Ubuntu" 2023-10-29T16:06:18.478 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="22.04" 2023-10-29T16:06:18.478 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-10-29T16:06:18.478 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_CODENAME=jammy 2023-10-29T16:06:18.479 INFO:teuthology.orchestra.run.smithi195.stdout:ID=ubuntu 2023-10-29T16:06:18.479 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE=debian 2023-10-29T16:06:18.479 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-29T16:06:18.479 INFO:teuthology.orchestra.run.smithi195.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-29T16:06:18.479 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-29T16:06:18.479 INFO:teuthology.orchestra.run.smithi195.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-29T16:06:18.480 INFO:teuthology.orchestra.run.smithi195.stdout:UBUNTU_CODENAME=jammy 2023-10-29T16:06:18.480 INFO:teuthology.provision.fog.smithi195:Deploy complete! 2023-10-29T16:06:18.480 DEBUG:teuthology.parallel:result is None 2023-10-29T16:06:21.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-29T16:07:21.167 WARNING:teuthology.provision.fog.smithi007:timed out 2023-10-29T16:07:27.169 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-29T16:07:27.172 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7 2023-10-29T16:07:33.173 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-29T16:07:33.391 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-29T16:07:33.391 DEBUG:teuthology.orchestra.run.smithi007:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-29T16:07:34.088 INFO:teuthology.provision.fog.smithi007:Node is ready 2023-10-29T16:07:34.089 DEBUG:teuthology.orchestra.run.smithi007:> hostname 2023-10-29T16:07:34.135 INFO:teuthology.orchestra.run.smithi007.stdout:smithi007.front.sepia.ceph.com 2023-10-29T16:07:34.135 DEBUG:teuthology.orchestra.run.smithi007:> grep smithi007.front.sepia.ceph.com /etc/hosts 2023-10-29T16:07:34.183 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7 smithi007.front.sepia.ceph.com smithi007 2023-10-29T16:07:34.184 DEBUG:teuthology.orchestra.run.smithi007:> sudo hostname smithi007 2023-10-29T16:07:34.308 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i -e 's/smithi007.front.sepia.ceph.com/smithi007/g' /etc/hosts 2023-10-29T16:07:34.322 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i -e 's/172.21.15.7/172.21.15.7/g' /etc/hosts 2023-10-29T16:07:34.383 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i -e 's/smithi007.front.sepia.ceph.com/smithi007/g' /etc/hostname 2023-10-29T16:07:34.440 DEBUG:teuthology.orchestra.run.smithi007:> sudo hostname smithi007 2023-10-29T16:07:34.494 DEBUG:teuthology.orchestra.run.smithi007:> cat /etc/os-release 2023-10-29T16:07:34.543 INFO:teuthology.orchestra.run.smithi007.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-10-29T16:07:34.543 INFO:teuthology.orchestra.run.smithi007.stdout:NAME="Ubuntu" 2023-10-29T16:07:34.543 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_ID="22.04" 2023-10-29T16:07:34.544 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-10-29T16:07:34.544 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_CODENAME=jammy 2023-10-29T16:07:34.544 INFO:teuthology.orchestra.run.smithi007.stdout:ID=ubuntu 2023-10-29T16:07:34.544 INFO:teuthology.orchestra.run.smithi007.stdout:ID_LIKE=debian 2023-10-29T16:07:34.544 INFO:teuthology.orchestra.run.smithi007.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-29T16:07:34.545 INFO:teuthology.orchestra.run.smithi007.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-29T16:07:34.545 INFO:teuthology.orchestra.run.smithi007.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-29T16:07:34.545 INFO:teuthology.orchestra.run.smithi007.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-29T16:07:34.545 INFO:teuthology.orchestra.run.smithi007.stdout:UBUNTU_CODENAME=jammy 2023-10-29T16:07:34.545 INFO:teuthology.provision.fog.smithi007:Deploy complete! 2023-10-29T16:07:34.546 DEBUG:teuthology.parallel:result is None 2023-10-29T16:07:35.744 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/lock/ops.py", line 326, in reimage_machines reimaged = do_update_keys(list(reimaged.keys()))[1] File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/lock/ops.py", line 290, in do_update_keys keys_dict = misc.ssh_keyscan(machines, _raise=_raise) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/misc.py", line 1108, in ssh_keyscan key = _ssh_keyscan(hostname) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/misc.py", line 1145, in _ssh_keyscan return sorted(keys)[0] IndexError: list index out of range 2023-10-29T16:07:35.745 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-29T16:07:35.899 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=62ffdab805d7417f90e5b0d23408745c Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/lock/ops.py", line 326, in reimage_machines reimaged = do_update_keys(list(reimaged.keys()))[1] File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/lock/ops.py", line 290, in do_update_keys keys_dict = misc.ssh_keyscan(machines, _raise=_raise) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/misc.py", line 1108, in ssh_keyscan key = _ssh_keyscan(hostname) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/misc.py", line 1145, in _ssh_keyscan return sorted(keys)[0] IndexError: list index out of range 2023-10-29T16:07:35.902 INFO:teuthology.nuke:Checking targets against current locks 2023-10-29T16:07:35.976 DEBUG:teuthology.nuke:shortname: smithi007 2023-10-29T16:07:35.976 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-29T16:07:35.985 DEBUG:teuthology.nuke:shortname: smithi183 2023-10-29T16:07:35.985 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-29T16:07:35.995 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi007.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-29_15:55:35-smoke-main-distro-default-smithi/7439992', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-29 15:59:12.166234', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-29T16:07:36.003 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi183.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-29_15:55:35-smoke-main-distro-default-smithi/7439992', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-29 15:59:12.168208', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-29T16:07:36.006 DEBUG:teuthology.nuke:shortname: smithi195 2023-10-29T16:07:36.006 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-29T16:07:36.025 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi195.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-29_15:55:35-smoke-main-distro-default-smithi/7439992', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-29 15:59:12.169990', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIXaqo7yAuJ9/TFiLySs7IB0mSJcE3UpMiywopen2770T/FZjOTiJKt2RQMCdB/DkPpMKTFTlDN29+CSwTSYx74='} 2023-10-29T16:07:36.037 INFO:teuthology.orchestra.console.smithi007:Power off 2023-10-29T16:07:36.038 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-29T16:07:36.067 INFO:teuthology.orchestra.console.smithi183:Power off 2023-10-29T16:07:36.068 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-29T16:07:36.085 INFO:teuthology.orchestra.console.smithi195:Power off 2023-10-29T16:07:36.086 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-29T16:07:36.093 DEBUG:teuthology.orchestra.console.smithi007:power off output: Chassis Power Control: Down/Off 2023-10-29T16:07:36.094 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-29T16:07:36.101 DEBUG:teuthology.orchestra.console.smithi183:power off output: Chassis Power Control: Down/Off 2023-10-29T16:07:36.103 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-29T16:07:36.112 DEBUG:teuthology.orchestra.console.smithi195:power off output: Chassis Power Control: Down/Off 2023-10-29T16:07:36.113 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-29T16:07:36.121 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is on 2023-10-29T16:07:36.126 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on 2023-10-29T16:07:36.134 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2023-10-29T16:07:40.123 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-29T16:07:40.130 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-29T16:07:40.137 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-29T16:07:40.233 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is on 2023-10-29T16:07:40.239 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on 2023-10-29T16:07:40.245 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2023-10-29T16:07:44.235 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-29T16:07:44.243 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-29T16:07:44.250 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-29T16:07:44.344 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is off 2023-10-29T16:07:44.352 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off 2023-10-29T16:07:44.359 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2023-10-29T16:07:44.446 INFO:teuthology.orchestra.console.smithi007:Power off completed 2023-10-29T16:07:44.453 INFO:teuthology.orchestra.console.smithi183:Power off completed 2023-10-29T16:07:44.603 INFO:teuthology.lock.ops:unlocked: smithi007.front.sepia.ceph.com 2023-10-29T16:07:44.611 INFO:teuthology.lock.ops:unlocked: smithi183.front.sepia.ceph.com 2023-10-29T16:07:48.360 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-29T16:07:48.472 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2023-10-29T16:07:48.573 INFO:teuthology.orchestra.console.smithi195:Power off completed 2023-10-29T16:07:48.737 INFO:teuthology.lock.ops:unlocked: smithi195.front.sepia.ceph.com 2023-10-29T16:07:49.091 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/dispatcher/supervisor.py", line 58, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/lock/ops.py", line 326, in reimage_machines reimaged = do_update_keys(list(reimaged.keys()))[1] File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/lock/ops.py", line 290, in do_update_keys keys_dict = misc.ssh_keyscan(machines, _raise=_raise) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/misc.py", line 1108, in ssh_keyscan key = _ssh_keyscan(hostname) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/misc.py", line 1145, in _ssh_keyscan return sorted(keys)[0] IndexError: list index out of range