2023-11-14T23:52:41.235 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-14T23:52:41.237 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-14T23:52:41.470 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f31da1a4670>, signals=[15]) 2023-11-14T23:52:41.471 INFO:teuthology.lock.ops:Start node 'smithi023.front.sepia.ceph.com' reimaging 2023-11-14T23:52:41.471 INFO:teuthology.lock.ops:Updating [smithi023.front.sepia.ceph.com]: reset os type and version on server 2023-11-14T23:52:41.472 INFO:teuthology.lock.ops:Updating smithi023.front.sepia.ceph.com on lock server 2023-11-14T23:52:41.494 INFO:teuthology.lock.ops:Start node 'smithi031.front.sepia.ceph.com' reimaging 2023-11-14T23:52:41.494 INFO:teuthology.lock.ops:Updating [smithi031.front.sepia.ceph.com]: reset os type and version on server 2023-11-14T23:52:41.495 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server 2023-11-14T23:52:41.496 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /host {"name": "smithi023"} 2023-11-14T23:52:41.518 INFO:teuthology.lock.ops:Start node 'smithi061.front.sepia.ceph.com' reimaging 2023-11-14T23:52:41.519 INFO:teuthology.lock.ops:Updating [smithi061.front.sepia.ceph.com]: reset os type and version on server 2023-11-14T23:52:41.519 INFO:teuthology.lock.ops:Updating smithi061.front.sepia.ceph.com on lock server 2023-11-14T23:52:41.520 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /host {"name": "smithi031"} 2023-11-14T23:52:41.544 INFO:teuthology.lock.ops:Start node 'smithi069.front.sepia.ceph.com' reimaging 2023-11-14T23:52:41.544 INFO:teuthology.lock.ops:Updating [smithi069.front.sepia.ceph.com]: reset os type and version on server 2023-11-14T23:52:41.544 INFO:teuthology.lock.ops:Updating smithi069.front.sepia.ceph.com on lock server 2023-11-14T23:52:41.545 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /host {"name": "smithi061"} 2023-11-14T23:52:41.573 INFO:teuthology.lock.ops:Start node 'smithi139.front.sepia.ceph.com' reimaging 2023-11-14T23:52:41.573 INFO:teuthology.lock.ops:Updating [smithi139.front.sepia.ceph.com]: reset os type and version on server 2023-11-14T23:52:41.573 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server 2023-11-14T23:52:41.574 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /host {"name": "smithi069"} 2023-11-14T23:52:41.594 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /host {"name": "smithi139"} 2023-11-14T23:52:41.599 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-11-14T23:52:41.602 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-11-14T23:52:41.609 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-11-14T23:52:41.645 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-11-14T23:52:41.648 DEBUG:teuthology.provision.fog.smithi061:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-11-14T23:52:41.648 DEBUG:teuthology.provision.fog.smithi061:FOG request: PUT /host/166 {"imageID": 2} 2023-11-14T23:52:41.649 DEBUG:teuthology.provision.fog.smithi031:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-11-14T23:52:41.649 DEBUG:teuthology.provision.fog.smithi031:FOG request: PUT /host/136 {"imageID": 2} 2023-11-14T23:52:41.653 DEBUG:teuthology.provision.fog.smithi023:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-11-14T23:52:41.653 DEBUG:teuthology.provision.fog.smithi023:FOG request: PUT /host/129 {"imageID": 2} 2023-11-14T23:52:41.679 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-11-14T23:52:41.684 DEBUG:teuthology.provision.fog.smithi069:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-11-14T23:52:41.684 DEBUG:teuthology.provision.fog.smithi069:FOG request: PUT /host/174 {"imageID": 2} 2023-11-14T23:52:41.707 INFO:teuthology.provision.fog.smithi061:Scheduling deploy of ubuntu 20.04 2023-11-14T23:52:41.707 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-11-14T23:52:41.711 INFO:teuthology.provision.fog.smithi023:Scheduling deploy of ubuntu 20.04 2023-11-14T23:52:41.711 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-11-14T23:52:41.712 INFO:teuthology.provision.fog.smithi031:Scheduling deploy of ubuntu 20.04 2023-11-14T23:52:41.712 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-11-14T23:52:41.719 DEBUG:teuthology.provision.fog.smithi139:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-11-14T23:52:41.720 DEBUG:teuthology.provision.fog.smithi139:FOG request: PUT /host/244 {"imageID": 2} 2023-11-14T23:52:41.737 INFO:teuthology.provision.fog.smithi069:Scheduling deploy of ubuntu 20.04 2023-11-14T23:52:41.737 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-11-14T23:52:41.751 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /tasktype {"name": "deploy"} 2023-11-14T23:52:41.753 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /tasktype {"name": "deploy"} 2023-11-14T23:52:41.756 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /tasktype {"name": "deploy"} 2023-11-14T23:52:41.760 INFO:teuthology.provision.fog.smithi139:Scheduling deploy of ubuntu 20.04 2023-11-14T23:52:41.760 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-11-14T23:52:41.786 DEBUG:teuthology.provision.fog.smithi061:FOG request: POST /host/166/task {"taskTypeID": 1} 2023-11-14T23:52:41.789 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /tasktype {"name": "deploy"} 2023-11-14T23:52:41.798 DEBUG:teuthology.provision.fog.smithi023:FOG request: POST /host/129/task {"taskTypeID": 1} 2023-11-14T23:52:41.802 DEBUG:teuthology.provision.fog.smithi031:FOG request: POST /host/136/task {"taskTypeID": 1} 2023-11-14T23:52:41.806 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /tasktype {"name": "deploy"} 2023-11-14T23:52:41.830 DEBUG:teuthology.provision.fog.smithi069:FOG request: POST /host/174/task {"taskTypeID": 1} 2023-11-14T23:52:41.854 DEBUG:teuthology.provision.fog.smithi139:FOG request: POST /host/244/task {"taskTypeID": 1} 2023-11-14T23:52:41.901 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-11-14T23:52:41.904 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-11-14T23:52:41.905 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-11-14T23:52:41.909 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-11-14T23:52:41.940 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-11-14T23:52:41.993 INFO:teuthology.orchestra.console.smithi031:Power off 2023-11-14T23:52:41.994 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-14T23:52:42.008 INFO:teuthology.orchestra.console.smithi139:Power off 2023-11-14T23:52:42.009 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-14T23:52:42.019 INFO:teuthology.orchestra.console.smithi023:Power off 2023-11-14T23:52:42.019 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-14T23:52:42.032 INFO:teuthology.orchestra.console.smithi061:Power off 2023-11-14T23:52:42.032 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-14T23:52:42.043 INFO:teuthology.orchestra.console.smithi069:Power off 2023-11-14T23:52:42.044 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-14T23:52:42.051 DEBUG:teuthology.orchestra.console.smithi139:power off output: Chassis Power Control: Down/Off 2023-11-14T23:52:42.051 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-14T23:52:42.058 DEBUG:teuthology.orchestra.console.smithi023:power off output: Chassis Power Control: Down/Off 2023-11-14T23:52:42.059 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-14T23:52:42.065 DEBUG:teuthology.orchestra.console.smithi031:power off output: Chassis Power Control: Down/Off 2023-11-14T23:52:42.066 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-14T23:52:42.073 DEBUG:teuthology.orchestra.console.smithi069:power off output: Chassis Power Control: Down/Off 2023-11-14T23:52:42.074 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-14T23:52:42.081 DEBUG:teuthology.orchestra.console.smithi061:power off output: Chassis Power Control: Down/Off 2023-11-14T23:52:42.082 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-14T23:52:42.089 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2023-11-14T23:52:42.090 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is on 2023-11-14T23:52:42.090 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is on 2023-11-14T23:52:42.094 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on 2023-11-14T23:52:42.103 DEBUG:teuthology.orchestra.console.smithi061:check power output: Chassis Power is on 2023-11-14T23:52:46.094 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-14T23:52:46.101 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-14T23:52:46.109 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-14T23:52:46.117 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-14T23:52:46.123 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-14T23:52:46.203 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2023-11-14T23:52:46.210 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is on 2023-11-14T23:52:46.217 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is on 2023-11-14T23:52:46.225 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on 2023-11-14T23:52:46.233 DEBUG:teuthology.orchestra.console.smithi061:check power output: Chassis Power is on 2023-11-14T23:52:50.208 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-14T23:52:50.216 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-14T23:52:50.222 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-14T23:52:50.229 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-14T23:52:50.235 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-14T23:52:50.318 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off 2023-11-14T23:52:50.325 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is on 2023-11-14T23:52:50.331 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is off 2023-11-14T23:52:50.337 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off 2023-11-14T23:52:50.344 DEBUG:teuthology.orchestra.console.smithi061:check power output: Chassis Power is off 2023-11-14T23:52:50.419 INFO:teuthology.orchestra.console.smithi031:Power off completed 2023-11-14T23:52:50.432 INFO:teuthology.orchestra.console.smithi023:Power off completed 2023-11-14T23:52:50.438 INFO:teuthology.orchestra.console.smithi069:Power off completed 2023-11-14T23:52:50.445 INFO:teuthology.orchestra.console.smithi061:Power off completed 2023-11-14T23:52:50.520 INFO:teuthology.orchestra.console.smithi031:Power on 2023-11-14T23:52:50.521 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-14T23:52:50.533 INFO:teuthology.orchestra.console.smithi023:Power on 2023-11-14T23:52:50.534 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-14T23:52:50.541 INFO:teuthology.orchestra.console.smithi069:Power on 2023-11-14T23:52:50.541 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-14T23:52:50.548 INFO:teuthology.orchestra.console.smithi061:Power on 2023-11-14T23:52:50.548 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-14T23:52:50.554 DEBUG:teuthology.orchestra.console.smithi031:power on output: Chassis Power Control: Up/On 2023-11-14T23:52:50.555 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-14T23:52:50.561 DEBUG:teuthology.orchestra.console.smithi023:power on output: Chassis Power Control: Up/On 2023-11-14T23:52:50.563 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-14T23:52:50.570 DEBUG:teuthology.orchestra.console.smithi069:power on output: Chassis Power Control: Up/On 2023-11-14T23:52:50.570 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-14T23:52:50.577 DEBUG:teuthology.orchestra.console.smithi061:power on output: Chassis Power Control: Up/On 2023-11-14T23:52:50.578 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-14T23:52:50.585 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off 2023-11-14T23:52:50.586 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is off 2023-11-14T23:52:50.593 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off 2023-11-14T23:52:50.599 DEBUG:teuthology.orchestra.console.smithi061:check power output: Chassis Power is off 2023-11-14T23:52:54.329 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-14T23:52:54.438 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is off 2023-11-14T23:52:54.539 INFO:teuthology.orchestra.console.smithi139:Power off completed 2023-11-14T23:52:54.587 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-14T23:52:54.594 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-14T23:52:54.601 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-14T23:52:54.607 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-14T23:52:54.640 INFO:teuthology.orchestra.console.smithi139:Power on 2023-11-14T23:52:54.641 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-14T23:52:54.664 DEBUG:teuthology.orchestra.console.smithi139:power on output: Chassis Power Control: Up/On 2023-11-14T23:52:54.664 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-14T23:52:54.684 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is off 2023-11-14T23:52:54.696 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off 2023-11-14T23:52:54.702 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is off 2023-11-14T23:52:54.709 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off 2023-11-14T23:52:54.717 DEBUG:teuthology.orchestra.console.smithi061:check power output: Chassis Power is off 2023-11-14T23:52:58.688 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-14T23:52:58.697 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-14T23:52:58.703 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-14T23:52:58.710 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-14T23:52:58.719 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-14T23:52:58.797 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is off 2023-11-14T23:52:58.805 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2023-11-14T23:52:58.811 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is on 2023-11-14T23:52:58.818 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on 2023-11-14T23:52:58.827 DEBUG:teuthology.orchestra.console.smithi061:check power output: Chassis Power is on 2023-11-14T23:52:58.906 INFO:teuthology.orchestra.console.smithi031:Power on completed 2023-11-14T23:52:58.912 INFO:teuthology.orchestra.console.smithi023:Power on completed 2023-11-14T23:52:58.919 INFO:teuthology.orchestra.console.smithi069:Power on completed 2023-11-14T23:52:58.928 INFO:teuthology.orchestra.console.smithi061:Power on completed 2023-11-14T23:52:59.007 INFO:teuthology.provision.fog.smithi031:Waiting for deploy to finish 2023-11-14T23:52:59.008 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-11-14T23:52:59.013 INFO:teuthology.provision.fog.smithi023:Waiting for deploy to finish 2023-11-14T23:52:59.013 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-11-14T23:52:59.020 INFO:teuthology.provision.fog.smithi069:Waiting for deploy to finish 2023-11-14T23:52:59.020 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-11-14T23:52:59.029 INFO:teuthology.provision.fog.smithi061:Waiting for deploy to finish 2023-11-14T23:52:59.029 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-11-14T23:53:02.802 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-14T23:53:02.910 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is on 2023-11-14T23:53:03.011 INFO:teuthology.orchestra.console.smithi139:Power on completed 2023-11-14T23:53:03.112 INFO:teuthology.provision.fog.smithi139:Waiting for deploy to finish 2023-11-14T23:53:03.112 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-11-14T23:53:14.089 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-11-14T23:53:14.091 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-11-14T23:53:14.092 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-11-14T23:53:14.093 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-11-14T23:53:18.170 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-11-14T23:53:29.161 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-11-14T23:53:29.162 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-11-14T23:53:29.167 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-11-14T23:53:29.168 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-11-14T23:53:33.226 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-11-14T23:53:44.234 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-11-14T23:53:44.235 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-11-14T23:53:44.243 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-11-14T23:53:44.246 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-11-14T23:53:48.286 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-11-14T23:53:59.309 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-11-14T23:53:59.310 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-11-14T23:53:59.311 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-11-14T23:53:59.312 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-11-14T23:54:03.342 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-11-14T23:54:14.386 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-11-14T23:54:14.388 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-11-14T23:54:14.388 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-11-14T23:54:14.389 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-11-14T23:54:18.410 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-11-14T23:54:29.464 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-11-14T23:54:29.466 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-11-14T23:54:29.470 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-11-14T23:54:29.471 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-11-14T23:54:33.472 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-11-14T23:54:44.538 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-11-14T23:54:44.540 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-11-14T23:54:44.541 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-11-14T23:54:44.546 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-11-14T23:54:48.534 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-11-14T23:54:59.614 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-11-14T23:54:59.615 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-11-14T23:54:59.627 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-11-14T23:54:59.628 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-11-14T23:55:03.598 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-11-14T23:55:14.694 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-11-14T23:55:14.695 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-11-14T23:55:14.700 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-11-14T23:55:14.701 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-11-14T23:55:18.658 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-11-14T23:55:29.774 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-11-14T23:55:29.776 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-11-14T23:55:29.777 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-11-14T23:55:29.778 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-11-14T23:55:33.730 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-11-14T23:55:44.844 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-11-14T23:55:44.846 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-11-14T23:55:44.850 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-11-14T23:55:44.852 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-11-14T23:55:48.795 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-11-14T23:55:59.910 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-11-14T23:55:59.912 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-11-14T23:55:59.919 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-11-14T23:55:59.920 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-11-14T23:56:03.854 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-11-14T23:56:14.978 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-11-14T23:56:14.980 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-11-14T23:56:14.980 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-11-14T23:56:14.986 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-11-14T23:56:15.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T23:56:15.174 ERROR:teuthology.orchestra.connection:Error authenticating with smithi031.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-11-14T23:56:18.915 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-11-14T23:56:30.054 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-11-14T23:56:30.057 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-11-14T23:56:30.058 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-11-14T23:56:30.116 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T23:56:30.195 ERROR:teuthology.orchestra.connection:Error authenticating with smithi069.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-11-14T23:56:33.990 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-11-14T23:56:45.137 DEBUG:teuthology.provision.fog.smithi061:FOG request: GET /task/active None 2023-11-14T23:56:45.139 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-11-14T23:56:45.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T23:56:48.250 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-11-14T23:56:49.047 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-11-14T23:56:49.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T23:56:52.158 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-11-14T23:56:54.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T23:56:57.306 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-11-14T23:56:58.160 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T23:57:00.193 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-11-14T23:57:01.210 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-11-14T23:57:03.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T23:57:06.366 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-11-14T23:57:07.212 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T23:57:10.266 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-11-14T23:57:12.368 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T23:57:15.250 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-11-14T23:57:15.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T23:57:15.422 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-11-14T23:57:16.267 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T23:57:18.362 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23 2023-11-14T23:57:19.178 WARNING:teuthology.provision.fog.smithi031:timed out 2023-11-14T23:57:19.322 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-11-14T23:57:21.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T23:57:24.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T23:57:24.506 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-11-14T23:57:25.180 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T23:57:25.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T23:57:27.418 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23 2023-11-14T23:57:28.378 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-11-14T23:57:30.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T23:57:33.420 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T23:57:33.566 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-11-14T23:57:34.198 WARNING:teuthology.provision.fog.smithi069:timed out 2023-11-14T23:57:34.380 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T23:57:36.474 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23 2023-11-14T23:57:37.434 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-11-14T23:57:39.568 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T23:57:40.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T23:57:42.476 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T23:57:42.618 WARNING:teuthology.provision.fog.smithi061:[Errno None] Unable to connect to port 22 on 172.21.15.61 2023-11-14T23:57:43.258 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-11-14T23:57:43.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T23:57:43.674 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31 2023-11-14T23:57:45.534 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23 2023-11-14T23:57:48.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T23:57:49.260 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T23:57:49.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T23:57:51.247 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-14T23:57:51.248 DEBUG:teuthology.orchestra.run.smithi031:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-14T23:57:51.539 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T23:57:51.715 INFO:teuthology.provision.fog.smithi031:Node is ready 2023-11-14T23:57:51.716 DEBUG:teuthology.orchestra.run.smithi031:> hostname 2023-11-14T23:57:51.722 INFO:teuthology.orchestra.run.smithi031.stdout:smithi129 2023-11-14T23:57:51.722 DEBUG:teuthology.orchestra.run.smithi031:> grep smithi129 /etc/hosts 2023-11-14T23:57:51.772 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.129 smithi129 smithi129 2023-11-14T23:57:51.772 DEBUG:teuthology.orchestra.run.smithi031:> sudo hostname smithi031 2023-11-14T23:57:51.858 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/smithi129/smithi031/g' /etc/hosts 2023-11-14T23:57:51.877 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/172.21.15.129/172.21.15.31/g' /etc/hosts 2023-11-14T23:57:51.938 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/smithi129/smithi031/g' /etc/hostname 2023-11-14T23:57:51.954 DEBUG:teuthology.orchestra.run.smithi031:> sudo hostname smithi031 2023-11-14T23:57:51.967 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release 2023-11-14T23:57:51.973 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="Ubuntu" 2023-11-14T23:57:51.974 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-14T23:57:51.974 INFO:teuthology.orchestra.run.smithi031.stdout:ID=ubuntu 2023-11-14T23:57:51.974 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE=debian 2023-11-14T23:57:51.974 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-14T23:57:51.975 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="20.04" 2023-11-14T23:57:51.975 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-14T23:57:51.975 INFO:teuthology.orchestra.run.smithi031.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-14T23:57:51.975 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-14T23:57:51.975 INFO:teuthology.orchestra.run.smithi031.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-14T23:57:51.976 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_CODENAME=focal 2023-11-14T23:57:51.976 INFO:teuthology.orchestra.run.smithi031.stdout:UBUNTU_CODENAME=focal 2023-11-14T23:57:51.976 INFO:teuthology.provision.fog.smithi031:Deploy complete! 2023-11-14T23:57:51.978 DEBUG:teuthology.parallel:result is None 2023-11-14T23:57:52.314 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-11-14T23:57:54.618 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23 2023-11-14T23:57:58.316 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T23:58:00.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T23:58:01.370 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-11-14T23:58:03.674 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23 2023-11-14T23:58:07.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T23:58:08.078 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-14T23:58:08.079 DEBUG:teuthology.orchestra.run.smithi069:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-14T23:58:09.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T23:58:12.730 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23 2023-11-14T23:58:16.203 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-14T23:58:16.203 DEBUG:teuthology.orchestra.run.smithi139:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-14T23:58:18.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T23:58:21.786 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23 2023-11-14T23:58:27.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T23:58:29.149 INFO:teuthology.provision.fog.smithi069:Node is ready 2023-11-14T23:58:29.150 DEBUG:teuthology.orchestra.run.smithi069:> hostname 2023-11-14T23:58:29.156 INFO:teuthology.orchestra.run.smithi069.stdout:smithi069.front.sepia.ceph.com 2023-11-14T23:58:29.157 DEBUG:teuthology.orchestra.run.smithi069:> grep smithi069.front.sepia.ceph.com /etc/hosts 2023-11-14T23:58:29.164 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69 smithi069.front.sepia.ceph.com smithi069 2023-11-14T23:58:29.164 DEBUG:teuthology.orchestra.run.smithi069:> sudo hostname smithi069 2023-11-14T23:58:29.275 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i -e 's/smithi069.front.sepia.ceph.com/smithi069/g' /etc/hosts 2023-11-14T23:58:29.291 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i -e 's/172.21.15.69/172.21.15.69/g' /etc/hosts 2023-11-14T23:58:29.306 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i -e 's/smithi069.front.sepia.ceph.com/smithi069/g' /etc/hostname 2023-11-14T23:58:29.364 DEBUG:teuthology.orchestra.run.smithi069:> sudo hostname smithi069 2023-11-14T23:58:29.379 DEBUG:teuthology.orchestra.run.smithi069:> cat /etc/os-release 2023-11-14T23:58:29.385 INFO:teuthology.orchestra.run.smithi069.stdout:NAME="Ubuntu" 2023-11-14T23:58:29.386 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-14T23:58:29.386 INFO:teuthology.orchestra.run.smithi069.stdout:ID=ubuntu 2023-11-14T23:58:29.386 INFO:teuthology.orchestra.run.smithi069.stdout:ID_LIKE=debian 2023-11-14T23:58:29.386 INFO:teuthology.orchestra.run.smithi069.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-14T23:58:29.387 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION_ID="20.04" 2023-11-14T23:58:29.387 INFO:teuthology.orchestra.run.smithi069.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-14T23:58:29.387 INFO:teuthology.orchestra.run.smithi069.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-14T23:58:29.387 INFO:teuthology.orchestra.run.smithi069.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-14T23:58:29.387 INFO:teuthology.orchestra.run.smithi069.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-14T23:58:29.388 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION_CODENAME=focal 2023-11-14T23:58:29.388 INFO:teuthology.orchestra.run.smithi069.stdout:UBUNTU_CODENAME=focal 2023-11-14T23:58:29.388 INFO:teuthology.provision.fog.smithi069:Deploy complete! 2023-11-14T23:58:29.389 DEBUG:teuthology.parallel:result is None 2023-11-14T23:58:30.846 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23 2023-11-14T23:58:36.848 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T23:58:37.862 INFO:teuthology.provision.fog.smithi139:Node is ready 2023-11-14T23:58:37.862 DEBUG:teuthology.orchestra.run.smithi139:> hostname 2023-11-14T23:58:37.869 INFO:teuthology.orchestra.run.smithi139.stdout:smithi139.front.sepia.ceph.com 2023-11-14T23:58:37.869 DEBUG:teuthology.orchestra.run.smithi139:> grep smithi139.front.sepia.ceph.com /etc/hosts 2023-11-14T23:58:37.877 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139 smithi139.front.sepia.ceph.com smithi139 2023-11-14T23:58:37.877 DEBUG:teuthology.orchestra.run.smithi139:> sudo hostname smithi139 2023-11-14T23:58:37.994 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/smithi139.front.sepia.ceph.com/smithi139/g' /etc/hosts 2023-11-14T23:58:38.011 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/172.21.15.139/172.21.15.139/g' /etc/hosts 2023-11-14T23:58:38.027 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/smithi139.front.sepia.ceph.com/smithi139/g' /etc/hostname 2023-11-14T23:58:38.090 DEBUG:teuthology.orchestra.run.smithi139:> sudo hostname smithi139 2023-11-14T23:58:38.099 DEBUG:teuthology.orchestra.run.smithi139:> cat /etc/os-release 2023-11-14T23:58:38.106 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="Ubuntu" 2023-11-14T23:58:38.107 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-14T23:58:38.107 INFO:teuthology.orchestra.run.smithi139.stdout:ID=ubuntu 2023-11-14T23:58:38.107 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE=debian 2023-11-14T23:58:38.107 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-14T23:58:38.108 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="20.04" 2023-11-14T23:58:38.108 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-14T23:58:38.109 INFO:teuthology.orchestra.run.smithi139.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-14T23:58:38.109 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-14T23:58:38.109 INFO:teuthology.orchestra.run.smithi139.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-14T23:58:38.109 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_CODENAME=focal 2023-11-14T23:58:38.109 INFO:teuthology.orchestra.run.smithi139.stdout:UBUNTU_CODENAME=focal 2023-11-14T23:58:38.110 INFO:teuthology.provision.fog.smithi139:Deploy complete! 2023-11-14T23:58:38.110 DEBUG:teuthology.parallel:result is None 2023-11-14T23:58:48.623 WARNING:teuthology.provision.fog.smithi061:timed out 2023-11-14T23:58:54.624 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T23:58:54.832 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-14T23:58:54.832 DEBUG:teuthology.orchestra.run.smithi061:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-14T23:58:55.316 INFO:teuthology.provision.fog.smithi061:Node is ready 2023-11-14T23:58:55.317 DEBUG:teuthology.orchestra.run.smithi061:> hostname 2023-11-14T23:58:55.323 INFO:teuthology.orchestra.run.smithi061.stdout:smithi061.front.sepia.ceph.com 2023-11-14T23:58:55.323 DEBUG:teuthology.orchestra.run.smithi061:> grep smithi061.front.sepia.ceph.com /etc/hosts 2023-11-14T23:58:55.331 INFO:teuthology.orchestra.run.smithi061.stdout:172.21.15.61 smithi061.front.sepia.ceph.com smithi061 2023-11-14T23:58:55.331 DEBUG:teuthology.orchestra.run.smithi061:> sudo hostname smithi061 2023-11-14T23:58:55.416 DEBUG:teuthology.orchestra.run.smithi061:> sudo sed -i -e 's/smithi061.front.sepia.ceph.com/smithi061/g' /etc/hosts 2023-11-14T23:58:55.432 DEBUG:teuthology.orchestra.run.smithi061:> sudo sed -i -e 's/172.21.15.61/172.21.15.61/g' /etc/hosts 2023-11-14T23:58:55.488 DEBUG:teuthology.orchestra.run.smithi061:> sudo sed -i -e 's/smithi061.front.sepia.ceph.com/smithi061/g' /etc/hostname 2023-11-14T23:58:55.501 DEBUG:teuthology.orchestra.run.smithi061:> sudo hostname smithi061 2023-11-14T23:58:55.514 DEBUG:teuthology.orchestra.run.smithi061:> cat /etc/os-release 2023-11-14T23:58:55.564 INFO:teuthology.orchestra.run.smithi061.stdout:NAME="Ubuntu" 2023-11-14T23:58:55.564 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-14T23:58:55.564 INFO:teuthology.orchestra.run.smithi061.stdout:ID=ubuntu 2023-11-14T23:58:55.565 INFO:teuthology.orchestra.run.smithi061.stdout:ID_LIKE=debian 2023-11-14T23:58:55.565 INFO:teuthology.orchestra.run.smithi061.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-14T23:58:55.566 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION_ID="20.04" 2023-11-14T23:58:55.566 INFO:teuthology.orchestra.run.smithi061.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-14T23:58:55.566 INFO:teuthology.orchestra.run.smithi061.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-14T23:58:55.567 INFO:teuthology.orchestra.run.smithi061.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-14T23:58:55.567 INFO:teuthology.orchestra.run.smithi061.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-14T23:58:55.567 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION_CODENAME=focal 2023-11-14T23:58:55.567 INFO:teuthology.orchestra.run.smithi061.stdout:UBUNTU_CODENAME=focal 2023-11-14T23:58:55.567 INFO:teuthology.provision.fog.smithi061:Deploy complete! 2023-11-14T23:58:55.568 DEBUG:teuthology.parallel:result is None 2023-11-14T23:59:36.850 WARNING:teuthology.provision.fog.smithi023:timed out 2023-11-14T23:59:42.853 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T23:59:43.072 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-14T23:59:43.073 DEBUG:teuthology.orchestra.run.smithi023:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-14T23:59:43.587 INFO:teuthology.provision.fog.smithi023:Node is ready 2023-11-14T23:59:43.587 DEBUG:teuthology.orchestra.run.smithi023:> hostname 2023-11-14T23:59:43.594 INFO:teuthology.orchestra.run.smithi023.stdout:smithi023.front.sepia.ceph.com 2023-11-14T23:59:43.594 DEBUG:teuthology.orchestra.run.smithi023:> grep smithi023.front.sepia.ceph.com /etc/hosts 2023-11-14T23:59:43.601 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23 smithi023.front.sepia.ceph.com smithi023 2023-11-14T23:59:43.602 DEBUG:teuthology.orchestra.run.smithi023:> sudo hostname smithi023 2023-11-14T23:59:43.749 DEBUG:teuthology.orchestra.run.smithi023:> sudo sed -i -e 's/smithi023.front.sepia.ceph.com/smithi023/g' /etc/hosts 2023-11-14T23:59:43.766 DEBUG:teuthology.orchestra.run.smithi023:> sudo sed -i -e 's/172.21.15.23/172.21.15.23/g' /etc/hosts 2023-11-14T23:59:43.777 DEBUG:teuthology.orchestra.run.smithi023:> sudo sed -i -e 's/smithi023.front.sepia.ceph.com/smithi023/g' /etc/hostname 2023-11-14T23:59:43.789 DEBUG:teuthology.orchestra.run.smithi023:> sudo hostname smithi023 2023-11-14T23:59:43.844 DEBUG:teuthology.orchestra.run.smithi023:> cat /etc/os-release 2023-11-14T23:59:43.848 INFO:teuthology.orchestra.run.smithi023.stdout:NAME="Ubuntu" 2023-11-14T23:59:43.848 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-14T23:59:43.848 INFO:teuthology.orchestra.run.smithi023.stdout:ID=ubuntu 2023-11-14T23:59:43.849 INFO:teuthology.orchestra.run.smithi023.stdout:ID_LIKE=debian 2023-11-14T23:59:43.849 INFO:teuthology.orchestra.run.smithi023.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-14T23:59:43.849 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION_ID="20.04" 2023-11-14T23:59:43.849 INFO:teuthology.orchestra.run.smithi023.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-14T23:59:43.850 INFO:teuthology.orchestra.run.smithi023.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-14T23:59:43.850 INFO:teuthology.orchestra.run.smithi023.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-14T23:59:43.850 INFO:teuthology.orchestra.run.smithi023.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-14T23:59:43.850 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION_CODENAME=focal 2023-11-14T23:59:43.850 INFO:teuthology.orchestra.run.smithi023.stdout:UBUNTU_CODENAME=focal 2023-11-14T23:59:43.851 INFO:teuthology.provision.fog.smithi023:Deploy complete! 2023-11-14T23:59:43.851 DEBUG:teuthology.parallel:result is None 2023-11-14T23:59:44.359 INFO:teuthology.lock.ops:Checking smithi023.front.sepia.ceph.com 2023-11-14T23:59:44.360 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-14T23:59:44.398 INFO:teuthology.lock.ops:Checking smithi031.front.sepia.ceph.com 2023-11-14T23:59:44.399 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-14T23:59:44.423 INFO:teuthology.lock.ops:Checking smithi061.front.sepia.ceph.com 2023-11-14T23:59:44.423 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-14T23:59:44.439 INFO:teuthology.lock.ops:Checking smithi069.front.sepia.ceph.com 2023-11-14T23:59:44.440 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-14T23:59:44.456 INFO:teuthology.lock.ops:Checking smithi139.front.sepia.ceph.com 2023-11-14T23:59:44.457 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-14T23:59:44.483 INFO:teuthology.lock.ops:Updating [smithi023.front.sepia.ceph.com]: set os type and version on server 2023-11-14T23:59:44.484 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi023.front.sepia.ceph.com' 2023-11-14T23:59:44.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T23:59:44.537 DEBUG:teuthology.orchestra.run.smithi023:> true 2023-11-14T23:59:44.660 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi023.front.sepia.ceph.com' 2023-11-14T23:59:44.660 DEBUG:teuthology.orchestra.run.smithi023:> uname -m 2023-11-14T23:59:44.666 INFO:teuthology.orchestra.run.smithi023.stdout:x86_64 2023-11-14T23:59:44.667 DEBUG:teuthology.orchestra.run.smithi023:> cat /etc/os-release 2023-11-14T23:59:44.673 INFO:teuthology.orchestra.run.smithi023.stdout:NAME="Ubuntu" 2023-11-14T23:59:44.673 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-14T23:59:44.674 INFO:teuthology.orchestra.run.smithi023.stdout:ID=ubuntu 2023-11-14T23:59:44.674 INFO:teuthology.orchestra.run.smithi023.stdout:ID_LIKE=debian 2023-11-14T23:59:44.674 INFO:teuthology.orchestra.run.smithi023.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-14T23:59:44.674 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION_ID="20.04" 2023-11-14T23:59:44.674 INFO:teuthology.orchestra.run.smithi023.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-14T23:59:44.675 INFO:teuthology.orchestra.run.smithi023.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-14T23:59:44.675 INFO:teuthology.orchestra.run.smithi023.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-14T23:59:44.675 INFO:teuthology.orchestra.run.smithi023.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-14T23:59:44.675 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION_CODENAME=focal 2023-11-14T23:59:44.675 INFO:teuthology.orchestra.run.smithi023.stdout:UBUNTU_CODENAME=focal 2023-11-14T23:59:44.676 INFO:teuthology.lock.ops:Updating smithi023.front.sepia.ceph.com on lock server 2023-11-14T23:59:44.698 INFO:teuthology.lock.ops:Updating [smithi031.front.sepia.ceph.com]: set os type and version on server 2023-11-14T23:59:44.698 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-11-14T23:59:44.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T23:59:44.748 DEBUG:teuthology.orchestra.run.smithi031:> true 2023-11-14T23:59:44.960 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-11-14T23:59:44.960 DEBUG:teuthology.orchestra.run.smithi031:> uname -m 2023-11-14T23:59:44.966 INFO:teuthology.orchestra.run.smithi031.stdout:x86_64 2023-11-14T23:59:44.967 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release 2023-11-14T23:59:44.973 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="Ubuntu" 2023-11-14T23:59:44.973 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-14T23:59:44.973 INFO:teuthology.orchestra.run.smithi031.stdout:ID=ubuntu 2023-11-14T23:59:44.974 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE=debian 2023-11-14T23:59:44.974 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-14T23:59:44.974 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="20.04" 2023-11-14T23:59:44.974 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-14T23:59:44.974 INFO:teuthology.orchestra.run.smithi031.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-14T23:59:44.975 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-14T23:59:44.975 INFO:teuthology.orchestra.run.smithi031.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-14T23:59:44.975 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_CODENAME=focal 2023-11-14T23:59:44.975 INFO:teuthology.orchestra.run.smithi031.stdout:UBUNTU_CODENAME=focal 2023-11-14T23:59:44.976 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server 2023-11-14T23:59:44.998 INFO:teuthology.lock.ops:Updating [smithi061.front.sepia.ceph.com]: set os type and version on server 2023-11-14T23:59:44.998 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi061.front.sepia.ceph.com' 2023-11-14T23:59:44.999 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T23:59:45.045 DEBUG:teuthology.orchestra.run.smithi061:> true 2023-11-14T23:59:45.255 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi061.front.sepia.ceph.com' 2023-11-14T23:59:45.256 DEBUG:teuthology.orchestra.run.smithi061:> uname -m 2023-11-14T23:59:45.262 INFO:teuthology.orchestra.run.smithi061.stdout:x86_64 2023-11-14T23:59:45.262 DEBUG:teuthology.orchestra.run.smithi061:> cat /etc/os-release 2023-11-14T23:59:45.269 INFO:teuthology.orchestra.run.smithi061.stdout:NAME="Ubuntu" 2023-11-14T23:59:45.269 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-14T23:59:45.269 INFO:teuthology.orchestra.run.smithi061.stdout:ID=ubuntu 2023-11-14T23:59:45.269 INFO:teuthology.orchestra.run.smithi061.stdout:ID_LIKE=debian 2023-11-14T23:59:45.270 INFO:teuthology.orchestra.run.smithi061.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-14T23:59:45.270 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION_ID="20.04" 2023-11-14T23:59:45.270 INFO:teuthology.orchestra.run.smithi061.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-14T23:59:45.270 INFO:teuthology.orchestra.run.smithi061.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-14T23:59:45.271 INFO:teuthology.orchestra.run.smithi061.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-14T23:59:45.271 INFO:teuthology.orchestra.run.smithi061.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-14T23:59:45.271 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION_CODENAME=focal 2023-11-14T23:59:45.271 INFO:teuthology.orchestra.run.smithi061.stdout:UBUNTU_CODENAME=focal 2023-11-14T23:59:45.271 INFO:teuthology.lock.ops:Updating smithi061.front.sepia.ceph.com on lock server 2023-11-14T23:59:45.306 INFO:teuthology.lock.ops:Updating [smithi069.front.sepia.ceph.com]: set os type and version on server 2023-11-14T23:59:45.306 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi069.front.sepia.ceph.com' 2023-11-14T23:59:45.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T23:59:45.353 DEBUG:teuthology.orchestra.run.smithi069:> true 2023-11-14T23:59:45.559 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi069.front.sepia.ceph.com' 2023-11-14T23:59:45.560 DEBUG:teuthology.orchestra.run.smithi069:> uname -m 2023-11-14T23:59:45.566 INFO:teuthology.orchestra.run.smithi069.stdout:x86_64 2023-11-14T23:59:45.566 DEBUG:teuthology.orchestra.run.smithi069:> cat /etc/os-release 2023-11-14T23:59:45.571 INFO:teuthology.orchestra.run.smithi069.stdout:NAME="Ubuntu" 2023-11-14T23:59:45.571 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-14T23:59:45.571 INFO:teuthology.orchestra.run.smithi069.stdout:ID=ubuntu 2023-11-14T23:59:45.572 INFO:teuthology.orchestra.run.smithi069.stdout:ID_LIKE=debian 2023-11-14T23:59:45.572 INFO:teuthology.orchestra.run.smithi069.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-14T23:59:45.572 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION_ID="20.04" 2023-11-14T23:59:45.572 INFO:teuthology.orchestra.run.smithi069.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-14T23:59:45.572 INFO:teuthology.orchestra.run.smithi069.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-14T23:59:45.572 INFO:teuthology.orchestra.run.smithi069.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-14T23:59:45.573 INFO:teuthology.orchestra.run.smithi069.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-14T23:59:45.573 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION_CODENAME=focal 2023-11-14T23:59:45.573 INFO:teuthology.orchestra.run.smithi069.stdout:UBUNTU_CODENAME=focal 2023-11-14T23:59:45.573 INFO:teuthology.lock.ops:Updating smithi069.front.sepia.ceph.com on lock server 2023-11-14T23:59:45.598 INFO:teuthology.lock.ops:Updating [smithi139.front.sepia.ceph.com]: set os type and version on server 2023-11-14T23:59:45.598 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2023-11-14T23:59:45.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-14T23:59:45.647 DEBUG:teuthology.orchestra.run.smithi139:> true 2023-11-14T23:59:45.847 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi139.front.sepia.ceph.com' 2023-11-14T23:59:45.848 DEBUG:teuthology.orchestra.run.smithi139:> uname -m 2023-11-14T23:59:45.854 INFO:teuthology.orchestra.run.smithi139.stdout:x86_64 2023-11-14T23:59:45.855 DEBUG:teuthology.orchestra.run.smithi139:> cat /etc/os-release 2023-11-14T23:59:45.861 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="Ubuntu" 2023-11-14T23:59:45.861 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-14T23:59:45.861 INFO:teuthology.orchestra.run.smithi139.stdout:ID=ubuntu 2023-11-14T23:59:45.861 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE=debian 2023-11-14T23:59:45.862 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-14T23:59:45.862 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="20.04" 2023-11-14T23:59:45.862 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-14T23:59:45.862 INFO:teuthology.orchestra.run.smithi139.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-14T23:59:45.862 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-14T23:59:45.863 INFO:teuthology.orchestra.run.smithi139.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-14T23:59:45.863 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_CODENAME=focal 2023-11-14T23:59:45.863 INFO:teuthology.orchestra.run.smithi139.stdout:UBUNTU_CODENAME=focal 2023-11-14T23:59:45.863 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server 2023-11-14T23:59:45.881 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-14T23:59:45.973 INFO:teuthology.dispatcher.supervisor:Running job 7458040 2023-11-14T23:59:45.974 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-11-14_20:31:57-fs-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi/7458040 --name yuriw-2023-11-14_20:31:57-fs-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi --description fs/multiclient/{begin clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/ior-shared-file} -- /home/teuthworker/archive/yuriw-2023-11-14_20:31:57-fs-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi/7458040/orig.config.yaml 2023-11-14T23:59:45.976 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-11-14_20:31:57-fs-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi/7458040 2023-11-14T23:59:45.977 INFO:teuthology.dispatcher.supervisor:Job PID: 3573220 2023-11-14T23:59:45.977 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-15T00:01:45.979 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T00:03:46.051 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T00:05:46.119 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T00:07:46.185 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T00:09:46.257 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T00:11:46.334 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T00:13:46.407 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T00:15:46.479 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T00:17:46.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T00:19:46.628 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-15T00:19:46.695 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-11-15T00:19:46.872 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-15T00:19:46.873 INFO:teuthology.nuke:Checking targets against current locks 2023-11-15T00:19:46.932 DEBUG:teuthology.nuke:shortname: smithi023 2023-11-15T00:19:46.933 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-15T00:19:46.957 DEBUG:teuthology.nuke:shortname: smithi031 2023-11-15T00:19:46.958 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-15T00:19:46.959 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi023.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-14_20:31:57-fs-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi/7458040', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-14 23:52:40.354607', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-11-15T00:19:46.980 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi031.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-14_20:31:57-fs-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi/7458040', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-14 23:52:40.358980', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-11-15T00:19:46.986 DEBUG:teuthology.nuke:shortname: smithi061 2023-11-15T00:19:46.986 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-15T00:19:47.002 DEBUG:teuthology.nuke:shortname: smithi069 2023-11-15T00:19:47.002 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-15T00:19:47.009 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi061.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-14_20:31:57-fs-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi/7458040', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-14 23:52:40.360026', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-11-15T00:19:47.018 INFO:teuthology.orchestra.console.smithi023:Power off 2023-11-15T00:19:47.019 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-15T00:19:47.030 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi069.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-14_20:31:57-fs-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi/7458040', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-14 23:52:40.357621', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-11-15T00:19:47.032 DEBUG:teuthology.nuke:shortname: smithi139 2023-11-15T00:19:47.032 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-15T00:19:47.038 INFO:teuthology.orchestra.console.smithi031:Power off 2023-11-15T00:19:47.039 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-15T00:19:47.054 DEBUG:teuthology.orchestra.console.smithi023:power off output: Chassis Power Control: Down/Off 2023-11-15T00:19:47.055 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T00:19:47.066 DEBUG:teuthology.orchestra.console.smithi031:power off output: Chassis Power Control: Down/Off 2023-11-15T00:19:47.067 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T00:19:47.080 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is off 2023-11-15T00:19:47.093 INFO:teuthology.orchestra.console.smithi061:Power off 2023-11-15T00:19:47.093 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-15T00:19:47.100 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi139.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-14_20:31:57-fs-wip-yuri4-testing-2023-11-13-0820-pacific-distro-default-smithi/7458040', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-14 23:52:40.356502', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-11-15T00:19:47.105 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off 2023-11-15T00:19:47.113 DEBUG:teuthology.orchestra.console.smithi061:power off output: Chassis Power Control: Down/Off 2023-11-15T00:19:47.114 DEBUG:teuthology.orchestra.console.smithi061:pexpect command: ipmitool -H smithi061.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T00:19:47.138 INFO:teuthology.orchestra.console.smithi069:Power off 2023-11-15T00:19:47.139 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-15T00:19:47.149 DEBUG:teuthology.orchestra.console.smithi061:check power output: Chassis Power is off 2023-11-15T00:19:47.160 DEBUG:teuthology.orchestra.console.smithi069:power off output: Chassis Power Control: Down/Off 2023-11-15T00:19:47.160 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T00:19:47.175 INFO:teuthology.orchestra.console.smithi139:Power off 2023-11-15T00:19:47.175 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-15T00:19:47.183 INFO:teuthology.orchestra.console.smithi023:Power off completed 2023-11-15T00:19:47.185 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off 2023-11-15T00:19:47.196 DEBUG:teuthology.orchestra.console.smithi139:power off output: Chassis Power Control: Down/Off 2023-11-15T00:19:47.197 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-15T00:19:47.206 INFO:teuthology.orchestra.console.smithi031:Power off completed 2023-11-15T00:19:47.218 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is off 2023-11-15T00:19:47.250 INFO:teuthology.orchestra.console.smithi061:Power off completed 2023-11-15T00:19:47.288 INFO:teuthology.orchestra.console.smithi069:Power off completed 2023-11-15T00:19:47.319 INFO:teuthology.orchestra.console.smithi139:Power off completed 2023-11-15T00:19:47.337 INFO:teuthology.lock.ops:unlocked: smithi023.front.sepia.ceph.com 2023-11-15T00:19:47.360 INFO:teuthology.lock.ops:unlocked: smithi031.front.sepia.ceph.com 2023-11-15T00:19:47.402 INFO:teuthology.lock.ops:unlocked: smithi061.front.sepia.ceph.com 2023-11-15T00:19:47.435 INFO:teuthology.lock.ops:unlocked: smithi069.front.sepia.ceph.com 2023-11-15T00:19:47.469 INFO:teuthology.lock.ops:unlocked: smithi139.front.sepia.ceph.com