2023-10-20T00:04:20.031 INFO:root:teuthology version: 0.0.1.dev201+g202b180 2023-10-20T00:04:20.032 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T00:04:20.204 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f611b85adc0>, signals=[15]) 2023-10-20T00:04:20.206 INFO:teuthology.lock.ops:Start node 'smithi040.front.sepia.ceph.com' reimaging 2023-10-20T00:04:20.206 INFO:teuthology.lock.ops:Updating [smithi040.front.sepia.ceph.com]: reset os type and version on server 2023-10-20T00:04:20.206 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server 2023-10-20T00:04:20.227 INFO:teuthology.lock.ops:Start node 'smithi154.front.sepia.ceph.com' reimaging 2023-10-20T00:04:20.228 INFO:teuthology.lock.ops:Updating [smithi154.front.sepia.ceph.com]: reset os type and version on server 2023-10-20T00:04:20.228 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2023-10-20T00:04:20.229 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /host {"name": "smithi040"} 2023-10-20T00:04:20.252 INFO:teuthology.lock.ops:Start node 'smithi167.front.sepia.ceph.com' reimaging 2023-10-20T00:04:20.253 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: reset os type and version on server 2023-10-20T00:04:20.253 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2023-10-20T00:04:20.255 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /host {"name": "smithi154"} 2023-10-20T00:04:20.278 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /host {"name": "smithi167"} 2023-10-20T00:04:20.314 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-10-20T00:04:20.327 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-10-20T00:04:20.342 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-10-20T00:04:20.634 DEBUG:teuthology.provision.fog.smithi040:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-10-20T00:04:20.635 DEBUG:teuthology.provision.fog.smithi040:FOG request: PUT /host/145 {"imageID": 2} 2023-10-20T00:04:20.639 DEBUG:teuthology.provision.fog.smithi167:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-10-20T00:04:20.639 DEBUG:teuthology.provision.fog.smithi167:FOG request: PUT /host/272 {"imageID": 2} 2023-10-20T00:04:20.640 DEBUG:teuthology.provision.fog.smithi154:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-10-20T00:04:20.640 DEBUG:teuthology.provision.fog.smithi154:FOG request: PUT /host/259 {"imageID": 2} 2023-10-20T00:04:20.687 INFO:teuthology.provision.fog.smithi154:Scheduling deploy of ubuntu 20.04 2023-10-20T00:04:20.688 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-10-20T00:04:20.691 INFO:teuthology.provision.fog.smithi040:Scheduling deploy of ubuntu 20.04 2023-10-20T00:04:20.691 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-10-20T00:04:20.695 INFO:teuthology.provision.fog.smithi167:Scheduling deploy of ubuntu 20.04 2023-10-20T00:04:20.695 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-10-20T00:04:20.738 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /tasktype {"name": "deploy"} 2023-10-20T00:04:20.741 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /tasktype {"name": "deploy"} 2023-10-20T00:04:20.744 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /tasktype {"name": "deploy"} 2023-10-20T00:04:20.774 DEBUG:teuthology.provision.fog.smithi167:FOG request: POST /host/272/task {"taskTypeID": 1} 2023-10-20T00:04:20.778 DEBUG:teuthology.provision.fog.smithi040:FOG request: POST /host/145/task {"taskTypeID": 1} 2023-10-20T00:04:20.787 DEBUG:teuthology.provision.fog.smithi154:FOG request: POST /host/259/task {"taskTypeID": 1} 2023-10-20T00:04:20.886 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-10-20T00:04:20.890 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-10-20T00:04:20.902 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-10-20T00:04:20.970 INFO:teuthology.orchestra.console.smithi040:Power off 2023-10-20T00:04:20.971 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-20T00:04:20.984 INFO:teuthology.orchestra.console.smithi154:Power off 2023-10-20T00:04:20.984 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-20T00:04:20.995 INFO:teuthology.orchestra.console.smithi167:Power off 2023-10-20T00:04:20.996 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-20T00:04:21.003 DEBUG:teuthology.orchestra.console.smithi040:power off output: Chassis Power Control: Down/Off 2023-10-20T00:04:21.004 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T00:04:21.012 DEBUG:teuthology.orchestra.console.smithi154:power off output: Chassis Power Control: Down/Off 2023-10-20T00:04:21.012 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T00:04:21.020 DEBUG:teuthology.orchestra.console.smithi167:power off output: Chassis Power Control: Down/Off 2023-10-20T00:04:21.020 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T00:04:21.030 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on 2023-10-20T00:04:21.033 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on 2023-10-20T00:04:21.045 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on 2023-10-20T00:04:25.034 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T00:04:25.042 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T00:04:25.048 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T00:04:25.144 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on 2023-10-20T00:04:25.150 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on 2023-10-20T00:04:25.157 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on 2023-10-20T00:04:29.149 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T00:04:29.156 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T00:04:29.163 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T00:04:29.258 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off 2023-10-20T00:04:29.265 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off 2023-10-20T00:04:29.272 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off 2023-10-20T00:04:29.360 INFO:teuthology.orchestra.console.smithi040:Power off completed 2023-10-20T00:04:29.367 INFO:teuthology.orchestra.console.smithi154:Power off completed 2023-10-20T00:04:29.374 INFO:teuthology.orchestra.console.smithi167:Power off completed 2023-10-20T00:04:29.461 INFO:teuthology.orchestra.console.smithi040:Power on 2023-10-20T00:04:29.462 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-20T00:04:29.471 INFO:teuthology.orchestra.console.smithi154:Power on 2023-10-20T00:04:29.472 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-20T00:04:29.478 INFO:teuthology.orchestra.console.smithi167:Power on 2023-10-20T00:04:29.479 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-20T00:04:29.487 DEBUG:teuthology.orchestra.console.smithi040:power on output: Chassis Power Control: Up/On 2023-10-20T00:04:29.487 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T00:04:29.496 DEBUG:teuthology.orchestra.console.smithi154:power on output: Chassis Power Control: Up/On 2023-10-20T00:04:29.497 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T00:04:29.504 DEBUG:teuthology.orchestra.console.smithi167:power on output: Chassis Power Control: Up/On 2023-10-20T00:04:29.505 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T00:04:29.513 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off 2023-10-20T00:04:29.517 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off 2023-10-20T00:04:29.524 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off 2023-10-20T00:04:33.518 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T00:04:33.526 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T00:04:33.533 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T00:04:33.627 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off 2023-10-20T00:04:33.635 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off 2023-10-20T00:04:33.640 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on 2023-10-20T00:04:33.741 INFO:teuthology.orchestra.console.smithi167:Power on completed 2023-10-20T00:04:33.842 INFO:teuthology.provision.fog.smithi167:Waiting for deploy to finish 2023-10-20T00:04:33.842 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-10-20T00:04:37.630 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T00:04:37.638 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T00:04:37.740 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on 2023-10-20T00:04:37.746 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on 2023-10-20T00:04:37.842 INFO:teuthology.orchestra.console.smithi040:Power on completed 2023-10-20T00:04:37.848 INFO:teuthology.orchestra.console.smithi154:Power on completed 2023-10-20T00:04:37.943 INFO:teuthology.provision.fog.smithi040:Waiting for deploy to finish 2023-10-20T00:04:37.944 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-10-20T00:04:37.949 INFO:teuthology.provision.fog.smithi154:Waiting for deploy to finish 2023-10-20T00:04:37.949 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-10-20T00:04:48.910 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-10-20T00:04:53.006 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-10-20T00:04:53.008 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-10-20T00:05:03.975 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-10-20T00:05:08.146 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-10-20T00:05:08.148 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-10-20T00:05:19.044 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-10-20T00:05:23.209 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-10-20T00:05:23.211 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-10-20T00:05:34.113 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-10-20T00:05:38.269 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-10-20T00:05:38.270 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-10-20T00:05:49.184 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-10-20T00:05:53.328 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-10-20T00:05:53.329 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-10-20T00:06:04.249 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-10-20T00:06:08.385 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-10-20T00:06:08.388 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-10-20T00:06:19.579 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-10-20T00:06:23.443 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-10-20T00:06:23.449 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-10-20T00:06:34.656 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-10-20T00:06:38.503 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-10-20T00:06:38.504 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-10-20T00:06:49.738 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-10-20T00:06:53.564 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-10-20T00:06:53.567 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-10-20T00:07:04.809 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-10-20T00:07:08.622 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-10-20T00:07:08.625 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-10-20T00:07:19.882 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-10-20T00:07:23.682 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-10-20T00:07:23.685 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-10-20T00:07:34.949 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-10-20T00:07:38.731 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-10-20T00:07:38.732 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-10-20T00:07:50.010 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-10-20T00:07:53.791 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-10-20T00:07:53.793 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-10-20T00:08:05.078 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-10-20T00:08:08.849 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-10-20T00:08:08.851 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-10-20T00:08:08.909 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T00:08:20.132 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-10-20T00:08:20.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T00:08:20.313 ERROR:teuthology.orchestra.connection:Error authenticating with smithi167.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-10-20T00:08:23.902 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-10-20T00:08:23.951 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T00:08:42.362 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-10-20T00:08:48.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T00:08:51.418 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-10-20T00:08:57.420 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T00:09:00.474 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-10-20T00:09:06.475 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T00:09:09.530 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-10-20T00:09:15.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T00:09:18.586 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-10-20T00:09:24.318 WARNING:teuthology.provision.fog.smithi167:timed out 2023-10-20T00:09:24.588 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T00:09:30.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T00:09:39.226 ERROR:teuthology.orchestra.connection:Error authenticating with smithi040.front.sepia.ceph.com: AuthenticationException('Authentication timeout.') 2023-10-20T00:09:48.666 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-10-20T00:09:50.499 ERROR:teuthology.orchestra.connection:Error authenticating with smithi040.front.sepia.ceph.com: BadHostKeyException('smithi040.front.sepia.ceph.com', , ) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 438, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi040.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw', expected 'AAAAC3NzaC1lZDI1NTE5AAAAINs9wlRI4jhhYRtWrQidrIg6DDspDculmJ82s6ROLltY' 2023-10-20T00:09:54.669 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T00:09:56.759 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-20T00:09:56.760 DEBUG:teuthology.orchestra.run.smithi154:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-20T00:09:57.532 ERROR:teuthology.orchestra.connection:Error authenticating with smithi040.front.sepia.ceph.com: BadHostKeyException('smithi040.front.sepia.ceph.com', , ) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 438, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi040.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw', expected 'AAAAC3NzaC1lZDI1NTE5AAAAINs9wlRI4jhhYRtWrQidrIg6DDspDculmJ82s6ROLltY' 2023-10-20T00:09:57.722 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-10-20T00:10:00.187 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-10-20T00:10:03.724 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T00:10:03.934 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-20T00:10:03.934 DEBUG:teuthology.orchestra.run.smithi167:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-20T00:10:07.565 ERROR:teuthology.orchestra.connection:Error authenticating with smithi040.front.sepia.ceph.com: BadHostKeyException('smithi040.front.sepia.ceph.com', , ) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 438, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi040.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw', expected 'AAAAC3NzaC1lZDI1NTE5AAAAINs9wlRI4jhhYRtWrQidrIg6DDspDculmJ82s6ROLltY' 2023-10-20T00:10:17.618 INFO:teuthology.provision.fog.smithi154:Node is ready 2023-10-20T00:10:17.618 DEBUG:teuthology.orchestra.run.smithi154:> hostname 2023-10-20T00:10:17.625 INFO:teuthology.orchestra.run.smithi154.stdout:smithi154.front.sepia.ceph.com 2023-10-20T00:10:17.625 DEBUG:teuthology.orchestra.run.smithi154:> grep smithi154.front.sepia.ceph.com /etc/hosts 2023-10-20T00:10:17.676 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154 smithi154.front.sepia.ceph.com smithi154 2023-10-20T00:10:17.676 DEBUG:teuthology.orchestra.run.smithi154:> sudo hostname smithi154 2023-10-20T00:10:17.750 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/smithi154.front.sepia.ceph.com/smithi154/g' /etc/hosts 2023-10-20T00:10:17.766 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/172.21.15.154/172.21.15.154/g' /etc/hosts 2023-10-20T00:10:17.823 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/smithi154.front.sepia.ceph.com/smithi154/g' /etc/hostname 2023-10-20T00:10:17.835 DEBUG:teuthology.orchestra.run.smithi154:> sudo hostname smithi154 2023-10-20T00:10:17.849 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release 2023-10-20T00:10:17.854 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="Ubuntu" 2023-10-20T00:10:17.855 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-20T00:10:17.855 INFO:teuthology.orchestra.run.smithi154.stdout:ID=ubuntu 2023-10-20T00:10:17.855 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE=debian 2023-10-20T00:10:17.855 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-20T00:10:17.856 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="20.04" 2023-10-20T00:10:17.856 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-20T00:10:17.856 INFO:teuthology.orchestra.run.smithi154.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-20T00:10:17.856 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-20T00:10:17.856 INFO:teuthology.orchestra.run.smithi154.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-20T00:10:17.857 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_CODENAME=focal 2023-10-20T00:10:17.857 INFO:teuthology.orchestra.run.smithi154.stdout:UBUNTU_CODENAME=focal 2023-10-20T00:10:17.858 INFO:teuthology.provision.fog.smithi154:Deploy complete! 2023-10-20T00:10:17.860 DEBUG:teuthology.parallel:result is None 2023-10-20T00:10:20.596 ERROR:teuthology.orchestra.connection:Error authenticating with smithi040.front.sepia.ceph.com: BadHostKeyException('smithi040.front.sepia.ceph.com', , ) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 438, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi040.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw', expected 'AAAAC3NzaC1lZDI1NTE5AAAAINs9wlRI4jhhYRtWrQidrIg6DDspDculmJ82s6ROLltY' 2023-10-20T00:10:25.089 INFO:teuthology.provision.fog.smithi167:Node is ready 2023-10-20T00:10:25.089 DEBUG:teuthology.orchestra.run.smithi167:> hostname 2023-10-20T00:10:25.096 INFO:teuthology.orchestra.run.smithi167.stdout:smithi167.front.sepia.ceph.com 2023-10-20T00:10:25.096 DEBUG:teuthology.orchestra.run.smithi167:> grep smithi167.front.sepia.ceph.com /etc/hosts 2023-10-20T00:10:25.104 INFO:teuthology.orchestra.run.smithi167.stdout:172.21.15.167 smithi167.front.sepia.ceph.com smithi167 2023-10-20T00:10:25.104 DEBUG:teuthology.orchestra.run.smithi167:> sudo hostname smithi167 2023-10-20T00:10:25.188 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/smithi167.front.sepia.ceph.com/smithi167/g' /etc/hosts 2023-10-20T00:10:25.205 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/172.21.15.167/172.21.15.167/g' /etc/hosts 2023-10-20T00:10:25.216 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/smithi167.front.sepia.ceph.com/smithi167/g' /etc/hostname 2023-10-20T00:10:25.227 DEBUG:teuthology.orchestra.run.smithi167:> sudo hostname smithi167 2023-10-20T00:10:25.238 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release 2023-10-20T00:10:25.243 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="Ubuntu" 2023-10-20T00:10:25.243 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-20T00:10:25.243 INFO:teuthology.orchestra.run.smithi167.stdout:ID=ubuntu 2023-10-20T00:10:25.243 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE=debian 2023-10-20T00:10:25.244 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-20T00:10:25.244 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="20.04" 2023-10-20T00:10:25.244 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-20T00:10:25.244 INFO:teuthology.orchestra.run.smithi167.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-20T00:10:25.245 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-20T00:10:25.245 INFO:teuthology.orchestra.run.smithi167.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-20T00:10:25.245 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_CODENAME=focal 2023-10-20T00:10:25.245 INFO:teuthology.orchestra.run.smithi167.stdout:UBUNTU_CODENAME=focal 2023-10-20T00:10:25.246 INFO:teuthology.provision.fog.smithi167:Deploy complete! 2023-10-20T00:10:25.246 DEBUG:teuthology.parallel:result is None 2023-10-20T00:10:36.626 ERROR:teuthology.orchestra.connection:Error authenticating with smithi040.front.sepia.ceph.com: BadHostKeyException('smithi040.front.sepia.ceph.com', , ) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 438, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi040.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw', expected 'AAAAC3NzaC1lZDI1NTE5AAAAINs9wlRI4jhhYRtWrQidrIg6DDspDculmJ82s6ROLltY' 2023-10-20T00:10:55.661 ERROR:teuthology.orchestra.connection:Error authenticating with smithi040.front.sepia.ceph.com: BadHostKeyException('smithi040.front.sepia.ceph.com', , ) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 438, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi040.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw', expected 'AAAAC3NzaC1lZDI1NTE5AAAAINs9wlRI4jhhYRtWrQidrIg6DDspDculmJ82s6ROLltY' 2023-10-20T00:11:17.694 ERROR:teuthology.orchestra.connection:Error authenticating with smithi040.front.sepia.ceph.com: BadHostKeyException('smithi040.front.sepia.ceph.com', , ) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 438, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi040.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw', expected 'AAAAC3NzaC1lZDI1NTE5AAAAINs9wlRI4jhhYRtWrQidrIg6DDspDculmJ82s6ROLltY' 2023-10-20T00:11:42.730 ERROR:teuthology.orchestra.connection:Error authenticating with smithi040.front.sepia.ceph.com: BadHostKeyException('smithi040.front.sepia.ceph.com', , ) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 438, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi040.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw', expected 'AAAAC3NzaC1lZDI1NTE5AAAAINs9wlRI4jhhYRtWrQidrIg6DDspDculmJ82s6ROLltY' 2023-10-20T00:12:10.766 ERROR:teuthology.orchestra.connection:Error authenticating with smithi040.front.sepia.ceph.com: BadHostKeyException('smithi040.front.sepia.ceph.com', , ) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 438, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi040.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw', expected 'AAAAC3NzaC1lZDI1NTE5AAAAINs9wlRI4jhhYRtWrQidrIg6DDspDculmJ82s6ROLltY' 2023-10-20T00:12:10.766 WARNING:teuthology.provision.fog.smithi040:'connect to smithi040.front.sepia.ceph.com' reached maximum tries (11) after waiting for 145 seconds 2023-10-20T00:12:16.769 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T00:12:16.956 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-20T00:12:16.956 DEBUG:teuthology.orchestra.run.smithi040:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-20T00:12:17.487 INFO:teuthology.provision.fog.smithi040:Node is ready 2023-10-20T00:12:17.488 DEBUG:teuthology.orchestra.run.smithi040:> hostname 2023-10-20T00:12:17.534 INFO:teuthology.orchestra.run.smithi040.stdout:smithi040.front.sepia.ceph.com 2023-10-20T00:12:17.535 DEBUG:teuthology.orchestra.run.smithi040:> grep smithi040.front.sepia.ceph.com /etc/hosts 2023-10-20T00:12:17.542 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40 smithi040.front.sepia.ceph.com smithi040 2023-10-20T00:12:17.542 DEBUG:teuthology.orchestra.run.smithi040:> sudo hostname smithi040 2023-10-20T00:12:17.626 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/smithi040.front.sepia.ceph.com/smithi040/g' /etc/hosts 2023-10-20T00:12:17.642 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/172.21.15.40/172.21.15.40/g' /etc/hosts 2023-10-20T00:12:17.701 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/smithi040.front.sepia.ceph.com/smithi040/g' /etc/hostname 2023-10-20T00:12:17.713 DEBUG:teuthology.orchestra.run.smithi040:> sudo hostname smithi040 2023-10-20T00:12:17.724 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release 2023-10-20T00:12:17.770 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="Ubuntu" 2023-10-20T00:12:17.771 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-20T00:12:17.771 INFO:teuthology.orchestra.run.smithi040.stdout:ID=ubuntu 2023-10-20T00:12:17.771 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE=debian 2023-10-20T00:12:17.771 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-20T00:12:17.772 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="20.04" 2023-10-20T00:12:17.772 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-20T00:12:17.772 INFO:teuthology.orchestra.run.smithi040.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-20T00:12:17.772 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-20T00:12:17.772 INFO:teuthology.orchestra.run.smithi040.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-20T00:12:17.773 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_CODENAME=focal 2023-10-20T00:12:17.773 INFO:teuthology.orchestra.run.smithi040.stdout:UBUNTU_CODENAME=focal 2023-10-20T00:12:17.773 INFO:teuthology.provision.fog.smithi040:Deploy complete! 2023-10-20T00:12:17.774 DEBUG:teuthology.parallel:result is None 2023-10-20T00:12:18.071 INFO:teuthology.lock.ops:Checking smithi040.front.sepia.ceph.com 2023-10-20T00:12:18.072 INFO:teuthology.lock.ops:Checking smithi154.front.sepia.ceph.com 2023-10-20T00:12:18.072 INFO:teuthology.lock.ops:Checking smithi167.front.sepia.ceph.com 2023-10-20T00:12:18.074 INFO:teuthology.lock.ops:Updating [smithi040.front.sepia.ceph.com]: set os type and version on server 2023-10-20T00:12:18.074 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-10-20T00:12:18.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T00:12:18.123 DEBUG:teuthology.orchestra.run.smithi040:> true 2023-10-20T00:12:18.243 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-10-20T00:12:18.244 DEBUG:teuthology.orchestra.run.smithi040:> uname -m 2023-10-20T00:12:18.290 INFO:teuthology.orchestra.run.smithi040.stdout:x86_64 2023-10-20T00:12:18.291 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release 2023-10-20T00:12:18.297 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="Ubuntu" 2023-10-20T00:12:18.297 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-20T00:12:18.298 INFO:teuthology.orchestra.run.smithi040.stdout:ID=ubuntu 2023-10-20T00:12:18.298 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE=debian 2023-10-20T00:12:18.298 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-20T00:12:18.298 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="20.04" 2023-10-20T00:12:18.298 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-20T00:12:18.299 INFO:teuthology.orchestra.run.smithi040.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-20T00:12:18.299 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-20T00:12:18.299 INFO:teuthology.orchestra.run.smithi040.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-20T00:12:18.299 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_CODENAME=focal 2023-10-20T00:12:18.299 INFO:teuthology.orchestra.run.smithi040.stdout:UBUNTU_CODENAME=focal 2023-10-20T00:12:18.300 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server 2023-10-20T00:12:18.337 INFO:teuthology.lock.ops:Updating [smithi154.front.sepia.ceph.com]: set os type and version on server 2023-10-20T00:12:18.337 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-10-20T00:12:18.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T00:12:18.383 DEBUG:teuthology.orchestra.run.smithi154:> true 2023-10-20T00:12:18.583 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-10-20T00:12:18.584 DEBUG:teuthology.orchestra.run.smithi154:> uname -m 2023-10-20T00:12:18.590 INFO:teuthology.orchestra.run.smithi154.stdout:x86_64 2023-10-20T00:12:18.590 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release 2023-10-20T00:12:18.639 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="Ubuntu" 2023-10-20T00:12:18.639 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-20T00:12:18.639 INFO:teuthology.orchestra.run.smithi154.stdout:ID=ubuntu 2023-10-20T00:12:18.639 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE=debian 2023-10-20T00:12:18.640 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-20T00:12:18.640 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="20.04" 2023-10-20T00:12:18.640 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-20T00:12:18.640 INFO:teuthology.orchestra.run.smithi154.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-20T00:12:18.640 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-20T00:12:18.640 INFO:teuthology.orchestra.run.smithi154.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-20T00:12:18.641 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_CODENAME=focal 2023-10-20T00:12:18.641 INFO:teuthology.orchestra.run.smithi154.stdout:UBUNTU_CODENAME=focal 2023-10-20T00:12:18.641 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2023-10-20T00:12:18.662 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: set os type and version on server 2023-10-20T00:12:18.662 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-10-20T00:12:18.662 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-20T00:12:18.710 DEBUG:teuthology.orchestra.run.smithi167:> true 2023-10-20T00:12:18.920 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-10-20T00:12:18.920 DEBUG:teuthology.orchestra.run.smithi167:> uname -m 2023-10-20T00:12:18.926 INFO:teuthology.orchestra.run.smithi167.stdout:x86_64 2023-10-20T00:12:18.926 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release 2023-10-20T00:12:18.932 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="Ubuntu" 2023-10-20T00:12:18.933 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-20T00:12:18.933 INFO:teuthology.orchestra.run.smithi167.stdout:ID=ubuntu 2023-10-20T00:12:18.933 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE=debian 2023-10-20T00:12:18.933 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-20T00:12:18.933 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="20.04" 2023-10-20T00:12:18.934 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-20T00:12:18.934 INFO:teuthology.orchestra.run.smithi167.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-20T00:12:18.934 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-20T00:12:18.934 INFO:teuthology.orchestra.run.smithi167.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-20T00:12:18.934 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_CODENAME=focal 2023-10-20T00:12:18.935 INFO:teuthology.orchestra.run.smithi167.stdout:UBUNTU_CODENAME=focal 2023-10-20T00:12:18.935 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2023-10-20T00:12:18.953 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T00:12:19.040 INFO:teuthology.dispatcher.supervisor:Running job 7432680 2023-10-20T00:12:19.040 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/bin/teuthology -v --owner scheduled_lflores@teuthology --archive /home/teuthworker/archive/lflores-2023-10-19_23:47:28-upgrade:quincy-p2p-quincy-release-distro-default-smithi/7432680 --name lflores-2023-10-19_23:47:28-upgrade:quincy-p2p-quincy-release-distro-default-smithi --description upgrade:quincy-p2p/quincy-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/quincy 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 6-final-workload/{rbd-python snaps-many-objects} objectstore/filestore-xfs supported-all-distro/ubuntu_latest thrashosds-health} -- /home/teuthworker/archive/lflores-2023-10-19_23:47:28-upgrade:quincy-p2p-quincy-release-distro-default-smithi/7432680/orig.config.yaml 2023-10-20T00:12:19.043 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/lflores-2023-10-19_23:47:28-upgrade:quincy-p2p-quincy-release-distro-default-smithi/7432680 2023-10-20T00:12:19.044 INFO:teuthology.dispatcher.supervisor:Job PID: 1970813 2023-10-20T00:12:19.044 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-20T00:14:19.046 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T00:16:19.122 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T00:18:19.188 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T00:20:19.261 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T00:22:19.325 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T00:24:19.399 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T00:26:19.465 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T00:28:19.532 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T00:30:19.622 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T00:32:19.703 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T00:34:19.768 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T00:36:19.849 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T00:38:19.914 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T00:40:19.977 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T00:42:20.052 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T00:44:20.124 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T00:46:20.203 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T00:48:20.268 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T00:50:20.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T00:52:20.406 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T00:54:20.474 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T00:56:20.568 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T00:58:20.641 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T01:00:20.713 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T01:02:20.778 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T01:04:20.850 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T01:06:20.921 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T01:08:20.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T01:10:21.060 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T01:12:21.134 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T01:14:21.196 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T01:16:21.276 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T01:18:21.335 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T01:20:21.406 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T01:22:21.477 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T01:24:21.553 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T01:26:21.622 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T01:28:21.698 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-20T01:28:21.758 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-20T01:28:21.991 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-20T01:28:21.991 INFO:teuthology.nuke:Checking targets against current locks 2023-10-20T01:28:22.042 DEBUG:teuthology.nuke:shortname: smithi040 2023-10-20T01:28:22.042 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-20T01:28:22.063 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi040.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2023-10-19_23:47:28-upgrade:quincy-p2p-quincy-release-distro-default-smithi/7432680', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-20 00:04:19.172091', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-20T01:28:22.070 DEBUG:teuthology.nuke:shortname: smithi154 2023-10-20T01:28:22.070 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-20T01:28:22.093 DEBUG:teuthology.nuke:shortname: smithi167 2023-10-20T01:28:22.093 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-20T01:28:22.097 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi154.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2023-10-19_23:47:28-upgrade:quincy-p2p-quincy-release-distro-default-smithi/7432680', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-20 00:04:19.173857', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-20T01:28:22.105 INFO:teuthology.orchestra.console.smithi040:Power off 2023-10-20T01:28:22.106 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-20T01:28:22.116 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi167.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2023-10-19_23:47:28-upgrade:quincy-p2p-quincy-release-distro-default-smithi/7432680', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-20 00:04:19.170079', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-20T01:28:22.129 DEBUG:teuthology.orchestra.console.smithi040:power off output: Chassis Power Control: Down/Off 2023-10-20T01:28:22.130 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T01:28:22.149 INFO:teuthology.orchestra.console.smithi154:Power off 2023-10-20T01:28:22.150 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-20T01:28:22.160 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off 2023-10-20T01:28:22.171 DEBUG:teuthology.orchestra.console.smithi154:power off output: Chassis Power Control: Down/Off 2023-10-20T01:28:22.171 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T01:28:22.184 INFO:teuthology.orchestra.console.smithi167:Power off 2023-10-20T01:28:22.184 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-20T01:28:22.193 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off 2023-10-20T01:28:22.207 DEBUG:teuthology.orchestra.console.smithi167:power off output: Chassis Power Control: Down/Off 2023-10-20T01:28:22.207 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-20T01:28:22.230 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off 2023-10-20T01:28:22.260 INFO:teuthology.orchestra.console.smithi040:Power off completed 2023-10-20T01:28:22.294 INFO:teuthology.orchestra.console.smithi154:Power off completed 2023-10-20T01:28:22.331 INFO:teuthology.orchestra.console.smithi167:Power off completed 2023-10-20T01:28:22.506 INFO:teuthology.lock.ops:unlocked: smithi040.front.sepia.ceph.com 2023-10-20T01:28:22.517 INFO:teuthology.lock.ops:unlocked: smithi167.front.sepia.ceph.com 2023-10-20T01:28:22.518 INFO:teuthology.lock.ops:unlocked: smithi154.front.sepia.ceph.com