2023-10-23T17:45:54.132 INFO:root:teuthology version: 0.0.1.dev201+g202b180 2023-10-23T17:45:54.133 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T17:45:54.307 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7c59411dc0>, signals=[15]) 2023-10-23T17:45:54.309 INFO:teuthology.lock.ops:Start node 'smithi146.front.sepia.ceph.com' reimaging 2023-10-23T17:45:54.309 INFO:teuthology.lock.ops:Updating [smithi146.front.sepia.ceph.com]: reset os type and version on server 2023-10-23T17:45:54.309 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server 2023-10-23T17:45:54.326 INFO:teuthology.lock.ops:Start node 'smithi151.front.sepia.ceph.com' reimaging 2023-10-23T17:45:54.326 INFO:teuthology.lock.ops:Updating [smithi151.front.sepia.ceph.com]: reset os type and version on server 2023-10-23T17:45:54.327 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server 2023-10-23T17:45:54.328 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /host {"name": "smithi146"} 2023-10-23T17:45:54.351 INFO:teuthology.lock.ops:Start node 'smithi158.front.sepia.ceph.com' reimaging 2023-10-23T17:45:54.351 INFO:teuthology.lock.ops:Updating [smithi158.front.sepia.ceph.com]: reset os type and version on server 2023-10-23T17:45:54.352 INFO:teuthology.lock.ops:Updating smithi158.front.sepia.ceph.com on lock server 2023-10-23T17:45:54.353 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /host {"name": "smithi151"} 2023-10-23T17:45:54.376 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /host {"name": "smithi158"} 2023-10-23T17:45:54.395 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-10-23T17:45:54.423 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-10-23T17:45:54.443 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-10-23T17:45:54.446 DEBUG:teuthology.provision.fog.smithi146:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-10-23T17:45:54.447 DEBUG:teuthology.provision.fog.smithi146:FOG request: PUT /host/251 {"imageID": 2} 2023-10-23T17:45:54.456 DEBUG:teuthology.provision.fog.smithi151:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-10-23T17:45:54.456 DEBUG:teuthology.provision.fog.smithi151:FOG request: PUT /host/256 {"imageID": 2} 2023-10-23T17:45:54.481 DEBUG:teuthology.provision.fog.smithi158:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-10-23T17:45:54.481 DEBUG:teuthology.provision.fog.smithi158:FOG request: PUT /host/263 {"imageID": 2} 2023-10-23T17:45:54.490 INFO:teuthology.provision.fog.smithi146:Scheduling deploy of ubuntu 20.04 2023-10-23T17:45:54.490 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-10-23T17:45:54.504 INFO:teuthology.provision.fog.smithi151:Scheduling deploy of ubuntu 20.04 2023-10-23T17:45:54.504 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-23T17:45:54.522 INFO:teuthology.provision.fog.smithi158:Scheduling deploy of ubuntu 20.04 2023-10-23T17:45:54.522 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-10-23T17:45:54.545 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /tasktype {"name": "deploy"} 2023-10-23T17:45:54.554 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /tasktype {"name": "deploy"} 2023-10-23T17:45:54.564 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /tasktype {"name": "deploy"} 2023-10-23T17:45:54.577 DEBUG:teuthology.provision.fog.smithi146:FOG request: POST /host/251/task {"taskTypeID": 1} 2023-10-23T17:45:54.592 DEBUG:teuthology.provision.fog.smithi151:FOG request: POST /host/256/task {"taskTypeID": 1} 2023-10-23T17:45:54.595 DEBUG:teuthology.provision.fog.smithi158:FOG request: POST /host/263/task {"taskTypeID": 1} 2023-10-23T17:45:54.632 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-10-23T17:45:54.640 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-23T17:45:54.664 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-10-23T17:45:54.718 INFO:teuthology.orchestra.console.smithi151:Power off 2023-10-23T17:45:54.719 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-23T17:45:54.733 INFO:teuthology.orchestra.console.smithi146:Power off 2023-10-23T17:45:54.734 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-23T17:45:54.743 DEBUG:teuthology.orchestra.console.smithi151:power off output: Chassis Power Control: Down/Off 2023-10-23T17:45:54.743 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-23T17:45:54.755 DEBUG:teuthology.orchestra.console.smithi146:power off output: Chassis Power Control: Down/Off 2023-10-23T17:45:54.755 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-23T17:45:54.768 INFO:teuthology.orchestra.console.smithi158:Power off 2023-10-23T17:45:54.768 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-23T17:45:54.776 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on 2023-10-23T17:45:54.777 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is on 2023-10-23T17:45:54.787 DEBUG:teuthology.orchestra.console.smithi158:power off output: Chassis Power Control: Down/Off 2023-10-23T17:45:54.788 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-23T17:45:54.809 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is on 2023-10-23T17:45:58.778 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-23T17:45:58.786 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-23T17:45:58.810 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-23T17:45:58.889 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on 2023-10-23T17:45:58.897 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is on 2023-10-23T17:45:58.919 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is on 2023-10-23T17:46:02.894 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-23T17:46:02.900 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-23T17:46:02.920 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-23T17:46:03.004 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on 2023-10-23T17:46:03.009 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is on 2023-10-23T17:46:03.029 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is on 2023-10-23T17:46:07.007 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-23T17:46:07.013 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-23T17:46:07.030 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-23T17:46:07.116 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off 2023-10-23T17:46:07.122 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is off 2023-10-23T17:46:07.138 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is off 2023-10-23T17:46:07.216 INFO:teuthology.orchestra.console.smithi151:Power off completed 2023-10-23T17:46:07.223 INFO:teuthology.orchestra.console.smithi146:Power off completed 2023-10-23T17:46:07.239 INFO:teuthology.orchestra.console.smithi158:Power off completed 2023-10-23T17:46:07.317 INFO:teuthology.orchestra.console.smithi151:Power on 2023-10-23T17:46:07.318 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-23T17:46:07.324 INFO:teuthology.orchestra.console.smithi146:Power on 2023-10-23T17:46:07.325 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-23T17:46:07.338 DEBUG:teuthology.orchestra.console.smithi151:power on output: Chassis Power Control: Up/On 2023-10-23T17:46:07.339 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-23T17:46:07.346 INFO:teuthology.orchestra.console.smithi158:Power on 2023-10-23T17:46:07.346 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-23T17:46:07.352 DEBUG:teuthology.orchestra.console.smithi146:power on output: Chassis Power Control: Up/On 2023-10-23T17:46:07.353 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-23T17:46:07.360 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off 2023-10-23T17:46:07.367 DEBUG:teuthology.orchestra.console.smithi158:power on output: Chassis Power Control: Up/On 2023-10-23T17:46:07.368 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-23T17:46:07.375 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is off 2023-10-23T17:46:07.386 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is off 2023-10-23T17:46:11.365 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-23T17:46:11.376 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-23T17:46:11.388 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-23T17:46:11.476 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on 2023-10-23T17:46:11.486 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is on 2023-10-23T17:46:11.497 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is off 2023-10-23T17:46:11.577 INFO:teuthology.orchestra.console.smithi151:Power on completed 2023-10-23T17:46:11.587 INFO:teuthology.orchestra.console.smithi146:Power on completed 2023-10-23T17:46:11.678 INFO:teuthology.provision.fog.smithi151:Waiting for deploy to finish 2023-10-23T17:46:11.679 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-23T17:46:11.688 INFO:teuthology.provision.fog.smithi146:Waiting for deploy to finish 2023-10-23T17:46:11.689 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-10-23T17:46:15.502 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-23T17:46:15.612 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is on 2023-10-23T17:46:15.713 INFO:teuthology.orchestra.console.smithi158:Power on completed 2023-10-23T17:46:15.814 INFO:teuthology.provision.fog.smithi158:Waiting for deploy to finish 2023-10-23T17:46:15.815 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-10-23T17:46:26.842 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-23T17:46:26.843 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-10-23T17:46:30.984 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-10-23T17:46:41.995 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-23T17:46:41.997 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-10-23T17:46:46.128 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-10-23T17:46:57.192 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-10-23T17:46:57.194 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-23T17:47:01.338 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-10-23T17:47:12.338 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-10-23T17:47:12.343 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-23T17:47:16.495 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-10-23T17:47:27.518 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-23T17:47:27.522 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-10-23T17:47:31.645 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-10-23T17:47:42.710 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-10-23T17:47:42.711 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-23T17:47:46.841 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-10-23T17:47:57.926 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-10-23T17:47:57.928 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-23T17:48:02.027 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-10-23T17:48:13.137 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-23T17:48:13.138 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-10-23T17:48:17.262 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-10-23T17:48:28.358 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-10-23T17:48:28.360 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-23T17:48:32.471 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-10-23T17:48:43.589 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-10-23T17:48:43.591 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-23T17:48:47.722 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-10-23T17:48:58.854 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-23T17:48:58.857 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-10-23T17:49:02.984 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-10-23T17:49:14.078 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-23T17:49:14.079 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-10-23T17:49:18.188 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-10-23T17:49:29.246 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-23T17:49:29.251 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-10-23T17:49:33.362 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-10-23T17:49:44.416 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-10-23T17:49:44.420 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-23T17:49:48.572 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-10-23T17:49:59.596 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-23T17:49:59.597 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-10-23T17:50:03.766 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-10-23T17:50:14.765 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-23T17:50:14.769 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-10-23T17:50:18.949 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-10-23T17:50:29.931 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-23T17:50:29.932 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-10-23T17:50:34.117 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-10-23T17:50:45.132 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-10-23T17:50:45.136 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-23T17:50:49.300 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-10-23T17:51:00.289 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-10-23T17:51:00.307 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-23T17:51:04.475 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-10-23T17:51:15.490 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-10-23T17:51:15.491 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-23T17:51:19.641 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-10-23T17:51:30.627 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-23T17:51:30.628 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-10-23T17:51:34.792 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-10-23T17:51:45.741 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-10-23T17:51:45.743 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-23T17:51:49.934 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-10-23T17:52:00.879 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-23T17:52:00.881 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-10-23T17:52:05.081 DEBUG:teuthology.provision.fog.smithi158:FOG request: GET /task/active None 2023-10-23T17:52:05.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-23T17:52:15.998 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None 2023-10-23T17:52:16.000 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-10-23T17:52:16.116 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-23T17:52:23.674 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-10-23T17:52:29.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-23T17:52:31.126 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-10-23T17:52:32.762 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-10-23T17:52:34.683 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-10-23T17:52:38.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-23T17:52:40.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-23T17:52:41.850 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-10-23T17:52:43.738 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-10-23T17:52:46.245 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-10-23T17:52:47.854 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-23T17:52:49.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-23T17:52:50.906 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-10-23T17:52:52.794 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-10-23T17:52:56.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-23T17:52:58.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-23T17:52:59.962 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-10-23T17:53:01.371 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-10-23T17:53:01.850 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-10-23T17:53:05.965 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-23T17:53:07.854 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-23T17:53:09.018 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-10-23T17:53:10.906 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-10-23T17:53:15.024 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-23T17:53:16.461 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-10-23T17:53:16.909 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-23T17:53:18.106 WARNING:teuthology.provision.fog.smithi158:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-10-23T17:53:24.111 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-23T17:53:31.562 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-10-23T17:53:46.647 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-10-23T17:53:48.811 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-23T17:53:48.812 DEBUG:teuthology.orchestra.run.smithi151:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-23T17:54:01.725 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-10-23T17:54:01.782 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-23T17:54:09.497 INFO:teuthology.provision.fog.smithi151:Node is ready 2023-10-23T17:54:09.498 DEBUG:teuthology.orchestra.run.smithi151:> hostname 2023-10-23T17:54:09.505 INFO:teuthology.orchestra.run.smithi151.stdout:smithi151.front.sepia.ceph.com 2023-10-23T17:54:09.506 DEBUG:teuthology.orchestra.run.smithi151:> grep smithi151.front.sepia.ceph.com /etc/hosts 2023-10-23T17:54:09.554 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.15.151 smithi151.front.sepia.ceph.com smithi151 2023-10-23T17:54:09.554 DEBUG:teuthology.orchestra.run.smithi151:> sudo hostname smithi151 2023-10-23T17:54:09.620 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/smithi151.front.sepia.ceph.com/smithi151/g' /etc/hosts 2023-10-23T17:54:09.636 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/172.21.15.151/172.21.15.151/g' /etc/hosts 2023-10-23T17:54:09.693 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/smithi151.front.sepia.ceph.com/smithi151/g' /etc/hostname 2023-10-23T17:54:09.705 DEBUG:teuthology.orchestra.run.smithi151:> sudo hostname smithi151 2023-10-23T17:54:09.716 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release 2023-10-23T17:54:09.765 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="Ubuntu" 2023-10-23T17:54:09.765 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-23T17:54:09.765 INFO:teuthology.orchestra.run.smithi151.stdout:ID=ubuntu 2023-10-23T17:54:09.766 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE=debian 2023-10-23T17:54:09.766 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-23T17:54:09.766 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="20.04" 2023-10-23T17:54:09.766 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-23T17:54:09.767 INFO:teuthology.orchestra.run.smithi151.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-23T17:54:09.767 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-23T17:54:09.767 INFO:teuthology.orchestra.run.smithi151.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-23T17:54:09.768 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_CODENAME=focal 2023-10-23T17:54:09.768 INFO:teuthology.orchestra.run.smithi151.stdout:UBUNTU_CODENAME=focal 2023-10-23T17:54:09.769 INFO:teuthology.provision.fog.smithi151:Deploy complete! 2023-10-23T17:54:09.770 DEBUG:teuthology.parallel:result is None 2023-10-23T17:54:24.113 WARNING:teuthology.provision.fog.smithi158:timed out 2023-10-23T17:54:30.116 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-23T17:54:30.321 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-23T17:54:30.322 DEBUG:teuthology.orchestra.run.smithi158:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-23T17:54:30.907 INFO:teuthology.provision.fog.smithi158:Node is ready 2023-10-23T17:54:30.908 DEBUG:teuthology.orchestra.run.smithi158:> hostname 2023-10-23T17:54:30.914 INFO:teuthology.orchestra.run.smithi158.stdout:smithi158.front.sepia.ceph.com 2023-10-23T17:54:30.914 DEBUG:teuthology.orchestra.run.smithi158:> grep smithi158.front.sepia.ceph.com /etc/hosts 2023-10-23T17:54:30.921 INFO:teuthology.orchestra.run.smithi158.stdout:172.21.15.158 smithi158.front.sepia.ceph.com smithi158 2023-10-23T17:54:30.922 DEBUG:teuthology.orchestra.run.smithi158:> sudo hostname smithi158 2023-10-23T17:54:31.036 DEBUG:teuthology.orchestra.run.smithi158:> sudo sed -i -e 's/smithi158.front.sepia.ceph.com/smithi158/g' /etc/hosts 2023-10-23T17:54:31.053 DEBUG:teuthology.orchestra.run.smithi158:> sudo sed -i -e 's/172.21.15.158/172.21.15.158/g' /etc/hosts 2023-10-23T17:54:31.064 DEBUG:teuthology.orchestra.run.smithi158:> sudo sed -i -e 's/smithi158.front.sepia.ceph.com/smithi158/g' /etc/hostname 2023-10-23T17:54:31.121 DEBUG:teuthology.orchestra.run.smithi158:> sudo hostname smithi158 2023-10-23T17:54:31.131 DEBUG:teuthology.orchestra.run.smithi158:> cat /etc/os-release 2023-10-23T17:54:31.136 INFO:teuthology.orchestra.run.smithi158.stdout:NAME="Ubuntu" 2023-10-23T17:54:31.136 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-23T17:54:31.136 INFO:teuthology.orchestra.run.smithi158.stdout:ID=ubuntu 2023-10-23T17:54:31.136 INFO:teuthology.orchestra.run.smithi158.stdout:ID_LIKE=debian 2023-10-23T17:54:31.137 INFO:teuthology.orchestra.run.smithi158.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-23T17:54:31.137 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_ID="20.04" 2023-10-23T17:54:31.137 INFO:teuthology.orchestra.run.smithi158.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-23T17:54:31.137 INFO:teuthology.orchestra.run.smithi158.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-23T17:54:31.137 INFO:teuthology.orchestra.run.smithi158.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-23T17:54:31.138 INFO:teuthology.orchestra.run.smithi158.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-23T17:54:31.138 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_CODENAME=focal 2023-10-23T17:54:31.138 INFO:teuthology.orchestra.run.smithi158.stdout:UBUNTU_CODENAME=focal 2023-10-23T17:54:31.138 INFO:teuthology.provision.fog.smithi158:Deploy complete! 2023-10-23T17:54:31.139 DEBUG:teuthology.parallel:result is None 2023-10-23T17:55:01.884 ERROR:teuthology.orchestra.connection:Error authenticating with smithi146.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 427, in connect server_key = t.get_remote_server_key() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 879, in get_remote_server_key raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2023-10-23T17:56:05.888 WARNING:teuthology.provision.fog.smithi146:timed out 2023-10-23T17:56:11.890 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-23T17:56:12.094 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-23T17:56:12.094 DEBUG:teuthology.orchestra.run.smithi146:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-23T17:56:12.637 INFO:teuthology.provision.fog.smithi146:Node is ready 2023-10-23T17:56:12.638 DEBUG:teuthology.orchestra.run.smithi146:> hostname 2023-10-23T17:56:12.644 INFO:teuthology.orchestra.run.smithi146.stdout:smithi146.front.sepia.ceph.com 2023-10-23T17:56:12.645 DEBUG:teuthology.orchestra.run.smithi146:> grep smithi146.front.sepia.ceph.com /etc/hosts 2023-10-23T17:56:12.651 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.146 smithi146.front.sepia.ceph.com smithi146 2023-10-23T17:56:12.651 DEBUG:teuthology.orchestra.run.smithi146:> sudo hostname smithi146 2023-10-23T17:56:12.779 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i -e 's/smithi146.front.sepia.ceph.com/smithi146/g' /etc/hosts 2023-10-23T17:56:12.795 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i -e 's/172.21.15.146/172.21.15.146/g' /etc/hosts 2023-10-23T17:56:12.805 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i -e 's/smithi146.front.sepia.ceph.com/smithi146/g' /etc/hostname 2023-10-23T17:56:12.817 DEBUG:teuthology.orchestra.run.smithi146:> sudo hostname smithi146 2023-10-23T17:56:12.827 DEBUG:teuthology.orchestra.run.smithi146:> cat /etc/os-release 2023-10-23T17:56:12.880 INFO:teuthology.orchestra.run.smithi146.stdout:NAME="Ubuntu" 2023-10-23T17:56:12.880 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-23T17:56:12.880 INFO:teuthology.orchestra.run.smithi146.stdout:ID=ubuntu 2023-10-23T17:56:12.880 INFO:teuthology.orchestra.run.smithi146.stdout:ID_LIKE=debian 2023-10-23T17:56:12.881 INFO:teuthology.orchestra.run.smithi146.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-23T17:56:12.881 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_ID="20.04" 2023-10-23T17:56:12.881 INFO:teuthology.orchestra.run.smithi146.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-23T17:56:12.881 INFO:teuthology.orchestra.run.smithi146.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-23T17:56:12.881 INFO:teuthology.orchestra.run.smithi146.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-23T17:56:12.882 INFO:teuthology.orchestra.run.smithi146.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-23T17:56:12.882 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_CODENAME=focal 2023-10-23T17:56:12.882 INFO:teuthology.orchestra.run.smithi146.stdout:UBUNTU_CODENAME=focal 2023-10-23T17:56:12.882 INFO:teuthology.provision.fog.smithi146:Deploy complete! 2023-10-23T17:56:12.883 DEBUG:teuthology.parallel:result is None 2023-10-23T17:56:13.201 INFO:teuthology.lock.ops:Checking smithi146.front.sepia.ceph.com 2023-10-23T17:56:13.202 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-23T17:56:13.240 INFO:teuthology.lock.ops:Checking smithi151.front.sepia.ceph.com 2023-10-23T17:56:13.240 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-23T17:56:13.264 INFO:teuthology.lock.ops:Checking smithi158.front.sepia.ceph.com 2023-10-23T17:56:13.264 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-23T17:56:13.281 INFO:teuthology.lock.ops:Updating [smithi146.front.sepia.ceph.com]: set os type and version on server 2023-10-23T17:56:13.282 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-10-23T17:56:13.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-23T17:56:13.332 DEBUG:teuthology.orchestra.run.smithi146:> true 2023-10-23T17:56:13.456 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-10-23T17:56:13.456 DEBUG:teuthology.orchestra.run.smithi146:> uname -m 2023-10-23T17:56:13.462 INFO:teuthology.orchestra.run.smithi146.stdout:x86_64 2023-10-23T17:56:13.463 DEBUG:teuthology.orchestra.run.smithi146:> cat /etc/os-release 2023-10-23T17:56:13.469 INFO:teuthology.orchestra.run.smithi146.stdout:NAME="Ubuntu" 2023-10-23T17:56:13.469 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-23T17:56:13.469 INFO:teuthology.orchestra.run.smithi146.stdout:ID=ubuntu 2023-10-23T17:56:13.469 INFO:teuthology.orchestra.run.smithi146.stdout:ID_LIKE=debian 2023-10-23T17:56:13.469 INFO:teuthology.orchestra.run.smithi146.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-23T17:56:13.470 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_ID="20.04" 2023-10-23T17:56:13.470 INFO:teuthology.orchestra.run.smithi146.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-23T17:56:13.470 INFO:teuthology.orchestra.run.smithi146.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-23T17:56:13.470 INFO:teuthology.orchestra.run.smithi146.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-23T17:56:13.470 INFO:teuthology.orchestra.run.smithi146.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-23T17:56:13.471 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_CODENAME=focal 2023-10-23T17:56:13.471 INFO:teuthology.orchestra.run.smithi146.stdout:UBUNTU_CODENAME=focal 2023-10-23T17:56:13.471 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server 2023-10-23T17:56:13.498 INFO:teuthology.lock.ops:Updating [smithi151.front.sepia.ceph.com]: set os type and version on server 2023-10-23T17:56:13.498 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-10-23T17:56:13.499 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-23T17:56:13.543 DEBUG:teuthology.orchestra.run.smithi151:> true 2023-10-23T17:56:13.747 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-10-23T17:56:13.748 DEBUG:teuthology.orchestra.run.smithi151:> uname -m 2023-10-23T17:56:13.754 INFO:teuthology.orchestra.run.smithi151.stdout:x86_64 2023-10-23T17:56:13.754 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release 2023-10-23T17:56:13.761 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="Ubuntu" 2023-10-23T17:56:13.761 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-23T17:56:13.761 INFO:teuthology.orchestra.run.smithi151.stdout:ID=ubuntu 2023-10-23T17:56:13.761 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE=debian 2023-10-23T17:56:13.761 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-23T17:56:13.762 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="20.04" 2023-10-23T17:56:13.762 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-23T17:56:13.762 INFO:teuthology.orchestra.run.smithi151.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-23T17:56:13.762 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-23T17:56:13.762 INFO:teuthology.orchestra.run.smithi151.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-23T17:56:13.763 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_CODENAME=focal 2023-10-23T17:56:13.763 INFO:teuthology.orchestra.run.smithi151.stdout:UBUNTU_CODENAME=focal 2023-10-23T17:56:13.763 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server 2023-10-23T17:56:13.789 INFO:teuthology.lock.ops:Updating [smithi158.front.sepia.ceph.com]: set os type and version on server 2023-10-23T17:56:13.789 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-10-23T17:56:13.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-23T17:56:13.839 DEBUG:teuthology.orchestra.run.smithi158:> true 2023-10-23T17:56:14.031 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-10-23T17:56:14.032 DEBUG:teuthology.orchestra.run.smithi158:> uname -m 2023-10-23T17:56:14.038 INFO:teuthology.orchestra.run.smithi158.stdout:x86_64 2023-10-23T17:56:14.038 DEBUG:teuthology.orchestra.run.smithi158:> cat /etc/os-release 2023-10-23T17:56:14.045 INFO:teuthology.orchestra.run.smithi158.stdout:NAME="Ubuntu" 2023-10-23T17:56:14.045 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-23T17:56:14.045 INFO:teuthology.orchestra.run.smithi158.stdout:ID=ubuntu 2023-10-23T17:56:14.045 INFO:teuthology.orchestra.run.smithi158.stdout:ID_LIKE=debian 2023-10-23T17:56:14.045 INFO:teuthology.orchestra.run.smithi158.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-23T17:56:14.046 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_ID="20.04" 2023-10-23T17:56:14.046 INFO:teuthology.orchestra.run.smithi158.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-23T17:56:14.046 INFO:teuthology.orchestra.run.smithi158.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-23T17:56:14.046 INFO:teuthology.orchestra.run.smithi158.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-23T17:56:14.046 INFO:teuthology.orchestra.run.smithi158.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-23T17:56:14.047 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_CODENAME=focal 2023-10-23T17:56:14.047 INFO:teuthology.orchestra.run.smithi158.stdout:UBUNTU_CODENAME=focal 2023-10-23T17:56:14.047 INFO:teuthology.lock.ops:Updating smithi158.front.sepia.ceph.com on lock server 2023-10-23T17:56:14.073 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T17:56:14.163 INFO:teuthology.dispatcher.supervisor:Running job 7434903 2023-10-23T17:56:14.163 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/bin/teuthology -v --owner scheduled_lflores@teuthology --archive /home/teuthworker/archive/lflores-2023-10-23_17:44:43-upgrade:quincy-p2p-quincy-release-distro-default-smithi/7434903 --name lflores-2023-10-23_17:44:43-upgrade:quincy-p2p-quincy-release-distro-default-smithi --description upgrade:quincy-p2p/quincy-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/quincy 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 6-final-workload/{rbd-python snaps-many-objects} objectstore/filestore-xfs supported-all-distro/ubuntu_latest thrashosds-health} -- /home/teuthworker/archive/lflores-2023-10-23_17:44:43-upgrade:quincy-p2p-quincy-release-distro-default-smithi/7434903/orig.config.yaml 2023-10-23T17:56:14.165 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/lflores-2023-10-23_17:44:43-upgrade:quincy-p2p-quincy-release-distro-default-smithi/7434903 2023-10-23T17:56:14.166 INFO:teuthology.dispatcher.supervisor:Job PID: 3511353 2023-10-23T17:56:14.166 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-23T17:56:39.162 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-10-23T17:58:14.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:00:14.431 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:02:14.691 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:04:14.867 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:06:15.091 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:08:15.245 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:10:15.415 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:12:15.575 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:14:15.649 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:16:15.767 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:18:15.940 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:20:16.111 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:22:16.286 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:24:16.433 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:26:16.597 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:28:16.769 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:30:16.939 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:32:17.103 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:34:17.284 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:36:17.455 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:38:17.615 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:40:17.782 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:42:17.944 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:44:18.102 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:46:18.232 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:48:18.391 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:50:18.547 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:52:18.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:54:18.884 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:56:18.968 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T18:58:19.138 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:00:19.307 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:02:19.467 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:04:19.642 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:06:19.769 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:08:19.922 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:10:20.034 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:12:20.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:14:20.230 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:16:20.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:18:20.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:20:20.730 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:22:20.904 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:24:21.050 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:26:22.933 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:28:23.070 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:30:23.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:32:23.362 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:34:23.435 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:36:23.589 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:38:23.685 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:40:23.852 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:42:24.024 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:44:24.195 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:46:24.434 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:48:24.692 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:50:24.864 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:52:25.024 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:54:25.100 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:56:25.169 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T19:58:25.336 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T20:00:25.482 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T20:02:25.678 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T20:04:25.886 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T20:06:26.047 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T20:08:26.222 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T20:10:26.435 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-23T20:10:26.588 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-23T20:10:26.805 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-23T20:10:26.805 INFO:teuthology.nuke:Checking targets against current locks 2023-10-23T20:10:26.850 DEBUG:teuthology.nuke:shortname: smithi146 2023-10-23T20:10:26.851 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-23T20:10:26.873 DEBUG:teuthology.nuke:shortname: smithi151 2023-10-23T20:10:26.873 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-23T20:10:26.876 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi146.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2023-10-23_17:44:43-upgrade:quincy-p2p-quincy-release-distro-default-smithi/7434903', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-23 17:45:53.305542', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-23T20:10:26.896 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi151.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2023-10-23_17:44:43-upgrade:quincy-p2p-quincy-release-distro-default-smithi/7434903', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-23 17:45:53.303337', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-23T20:10:26.900 DEBUG:teuthology.nuke:shortname: smithi158 2023-10-23T20:10:26.900 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-23T20:10:26.921 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi158.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2023-10-23_17:44:43-upgrade:quincy-p2p-quincy-release-distro-default-smithi/7434903', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-23 17:45:53.306825', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-23T20:10:26.930 INFO:teuthology.orchestra.console.smithi146:Power off 2023-10-23T20:10:26.931 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-23T20:10:26.955 DEBUG:teuthology.orchestra.console.smithi146:power off output: Chassis Power Control: Down/Off 2023-10-23T20:10:26.956 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-23T20:10:26.967 INFO:teuthology.orchestra.console.smithi151:Power off 2023-10-23T20:10:26.968 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-23T20:10:26.979 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is off 2023-10-23T20:10:26.986 DEBUG:teuthology.orchestra.console.smithi151:power off output: Chassis Power Control: Down/Off 2023-10-23T20:10:26.986 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-23T20:10:27.005 INFO:teuthology.orchestra.console.smithi158:Power off 2023-10-23T20:10:27.005 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-23T20:10:27.013 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off 2023-10-23T20:10:27.024 DEBUG:teuthology.orchestra.console.smithi158:power off output: Chassis Power Control: Down/Off 2023-10-23T20:10:27.024 DEBUG:teuthology.orchestra.console.smithi158:pexpect command: ipmitool -H smithi158.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-23T20:10:27.043 DEBUG:teuthology.orchestra.console.smithi158:check power output: Chassis Power is off 2023-10-23T20:10:27.081 INFO:teuthology.orchestra.console.smithi146:Power off completed 2023-10-23T20:10:27.115 INFO:teuthology.orchestra.console.smithi151:Power off completed 2023-10-23T20:10:27.144 INFO:teuthology.orchestra.console.smithi158:Power off completed 2023-10-23T20:10:27.248 INFO:teuthology.lock.ops:unlocked: smithi146.front.sepia.ceph.com 2023-10-23T20:10:27.261 INFO:teuthology.lock.ops:unlocked: smithi151.front.sepia.ceph.com 2023-10-23T20:10:27.294 INFO:teuthology.lock.ops:unlocked: smithi158.front.sepia.ceph.com