2023-10-03T18:55:02.866 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-03T18:55:02.867 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-03T18:55:03.121 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff967054670>, signals=[15]) 2023-10-03T18:55:03.122 INFO:teuthology.lock.ops:Start node 'smithi019.front.sepia.ceph.com' reimaging 2023-10-03T18:55:03.122 INFO:teuthology.lock.ops:Updating [smithi019.front.sepia.ceph.com]: reset os type and version on server 2023-10-03T18:55:03.122 INFO:teuthology.lock.ops:Updating smithi019.front.sepia.ceph.com on lock server 2023-10-03T18:55:03.147 INFO:teuthology.lock.ops:Start node 'smithi064.front.sepia.ceph.com' reimaging 2023-10-03T18:55:03.147 INFO:teuthology.lock.ops:Updating [smithi064.front.sepia.ceph.com]: reset os type and version on server 2023-10-03T18:55:03.147 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server 2023-10-03T18:55:03.148 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /host {"name": "smithi019"} 2023-10-03T18:55:03.172 INFO:teuthology.lock.ops:Start node 'smithi072.front.sepia.ceph.com' reimaging 2023-10-03T18:55:03.172 INFO:teuthology.lock.ops:Updating [smithi072.front.sepia.ceph.com]: reset os type and version on server 2023-10-03T18:55:03.172 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server 2023-10-03T18:55:03.173 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /host {"name": "smithi064"} 2023-10-03T18:55:03.199 INFO:teuthology.lock.ops:Start node 'smithi125.front.sepia.ceph.com' reimaging 2023-10-03T18:55:03.199 INFO:teuthology.lock.ops:Updating [smithi125.front.sepia.ceph.com]: reset os type and version on server 2023-10-03T18:55:03.199 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server 2023-10-03T18:55:03.200 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /host {"name": "smithi072"} 2023-10-03T18:55:03.221 INFO:teuthology.lock.ops:Start node 'smithi163.front.sepia.ceph.com' reimaging 2023-10-03T18:55:03.221 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: reset os type and version on server 2023-10-03T18:55:03.222 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2023-10-03T18:55:03.223 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /host {"name": "smithi125"} 2023-10-03T18:55:03.229 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-10-03T18:55:03.247 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /host {"name": "smithi163"} 2023-10-03T18:55:03.253 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-10-03T18:55:03.275 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-10-03T18:55:03.278 DEBUG:teuthology.provision.fog.smithi019:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-10-03T18:55:03.278 DEBUG:teuthology.provision.fog.smithi019:FOG request: PUT /host/125 {"imageID": 6} 2023-10-03T18:55:03.304 DEBUG:teuthology.provision.fog.smithi064:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-10-03T18:55:03.304 DEBUG:teuthology.provision.fog.smithi064:FOG request: PUT /host/169 {"imageID": 6} 2023-10-03T18:55:03.307 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-10-03T18:55:03.316 DEBUG:teuthology.provision.fog.smithi072:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-10-03T18:55:03.316 DEBUG:teuthology.provision.fog.smithi072:FOG request: PUT /host/177 {"imageID": 6} 2023-10-03T18:55:03.324 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-10-03T18:55:03.329 INFO:teuthology.provision.fog.smithi019:Scheduling deploy of ubuntu 22.04 2023-10-03T18:55:03.329 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-10-03T18:55:03.353 DEBUG:teuthology.provision.fog.smithi125:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-10-03T18:55:03.353 DEBUG:teuthology.provision.fog.smithi125:FOG request: PUT /host/230 {"imageID": 6} 2023-10-03T18:55:03.360 INFO:teuthology.provision.fog.smithi064:Scheduling deploy of ubuntu 22.04 2023-10-03T18:55:03.360 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-10-03T18:55:03.370 INFO:teuthology.provision.fog.smithi072:Scheduling deploy of ubuntu 22.04 2023-10-03T18:55:03.370 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-10-03T18:55:03.380 DEBUG:teuthology.provision.fog.smithi163:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-10-03T18:55:03.380 DEBUG:teuthology.provision.fog.smithi163:FOG request: PUT /host/268 {"imageID": 6} 2023-10-03T18:55:03.410 INFO:teuthology.provision.fog.smithi125:Scheduling deploy of ubuntu 22.04 2023-10-03T18:55:03.410 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-10-03T18:55:03.445 INFO:teuthology.provision.fog.smithi163:Scheduling deploy of ubuntu 22.04 2023-10-03T18:55:03.445 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-03T18:55:03.483 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /tasktype {"name": "deploy"} 2023-10-03T18:55:03.496 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /tasktype {"name": "deploy"} 2023-10-03T18:55:03.512 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /tasktype {"name": "deploy"} 2023-10-03T18:55:03.529 DEBUG:teuthology.provision.fog.smithi019:FOG request: POST /host/125/task {"taskTypeID": 1} 2023-10-03T18:55:03.547 DEBUG:teuthology.provision.fog.smithi064:FOG request: POST /host/169/task {"taskTypeID": 1} 2023-10-03T18:55:03.565 DEBUG:teuthology.provision.fog.smithi072:FOG request: POST /host/177/task {"taskTypeID": 1} 2023-10-03T18:55:03.570 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /tasktype {"name": "deploy"} 2023-10-03T18:55:03.604 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-10-03T18:55:03.608 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /tasktype {"name": "deploy"} 2023-10-03T18:55:03.611 DEBUG:teuthology.provision.fog.smithi125:FOG request: POST /host/230/task {"taskTypeID": 1} 2023-10-03T18:55:03.658 DEBUG:teuthology.provision.fog.smithi163:FOG request: POST /host/268/task {"taskTypeID": 1} 2023-10-03T18:55:03.693 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-10-03T18:55:03.704 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-10-03T18:55:03.713 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-03T18:55:03.725 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-10-03T18:55:03.835 INFO:teuthology.orchestra.console.smithi019:Power off 2023-10-03T18:55:03.835 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-03T18:55:03.858 DEBUG:teuthology.orchestra.console.smithi019:power off output: Chassis Power Control: Down/Off 2023-10-03T18:55:03.858 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T18:55:03.882 INFO:teuthology.orchestra.console.smithi064:Power off 2023-10-03T18:55:03.883 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-03T18:55:03.891 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is on 2023-10-03T18:55:03.902 INFO:teuthology.orchestra.console.smithi163:Power off 2023-10-03T18:55:03.903 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-03T18:55:03.912 DEBUG:teuthology.orchestra.console.smithi064:power off output: Chassis Power Control: Down/Off 2023-10-03T18:55:03.912 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T18:55:03.925 DEBUG:teuthology.orchestra.console.smithi163:power off output: Chassis Power Control: Down/Off 2023-10-03T18:55:03.925 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T18:55:03.945 INFO:teuthology.orchestra.console.smithi125:Power off 2023-10-03T18:55:03.946 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-03T18:55:03.953 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2023-10-03T18:55:03.954 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on 2023-10-03T18:55:03.966 DEBUG:teuthology.orchestra.console.smithi125:power off output: Chassis Power Control: Down/Off 2023-10-03T18:55:03.967 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T18:55:03.980 INFO:teuthology.orchestra.console.smithi072:Power off 2023-10-03T18:55:03.980 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-03T18:55:03.990 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is on 2023-10-03T18:55:04.005 DEBUG:teuthology.orchestra.console.smithi072:power off output: Chassis Power Control: Down/Off 2023-10-03T18:55:04.005 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T18:55:04.027 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2023-10-03T18:55:07.894 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T18:55:07.955 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T18:55:07.962 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T18:55:07.991 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T18:55:08.004 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is on 2023-10-03T18:55:08.028 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T18:55:08.064 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2023-10-03T18:55:08.070 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on 2023-10-03T18:55:08.100 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is on 2023-10-03T18:55:08.137 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2023-10-03T18:55:12.006 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T18:55:12.065 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T18:55:12.073 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T18:55:12.101 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T18:55:12.116 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is on 2023-10-03T18:55:12.139 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T18:55:12.175 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2023-10-03T18:55:12.182 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on 2023-10-03T18:55:12.209 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off 2023-10-03T18:55:12.248 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2023-10-03T18:55:12.311 INFO:teuthology.orchestra.console.smithi125:Power off completed 2023-10-03T18:55:12.411 INFO:teuthology.orchestra.console.smithi125:Power on 2023-10-03T18:55:12.411 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-03T18:55:12.434 DEBUG:teuthology.orchestra.console.smithi125:power on output: Chassis Power Control: Up/On 2023-10-03T18:55:12.434 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T18:55:12.456 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off 2023-10-03T18:55:16.119 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T18:55:16.176 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T18:55:16.183 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T18:55:16.228 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is off 2023-10-03T18:55:16.249 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T18:55:16.285 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off 2023-10-03T18:55:16.291 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off 2023-10-03T18:55:16.329 INFO:teuthology.orchestra.console.smithi019:Power off completed 2023-10-03T18:55:16.357 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off 2023-10-03T18:55:16.386 INFO:teuthology.orchestra.console.smithi064:Power off completed 2023-10-03T18:55:16.392 INFO:teuthology.orchestra.console.smithi163:Power off completed 2023-10-03T18:55:16.430 INFO:teuthology.orchestra.console.smithi019:Power on 2023-10-03T18:55:16.431 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-03T18:55:16.452 DEBUG:teuthology.orchestra.console.smithi019:power on output: Chassis Power Control: Up/On 2023-10-03T18:55:16.453 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T18:55:16.460 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T18:55:16.467 INFO:teuthology.orchestra.console.smithi072:Power off completed 2023-10-03T18:55:16.477 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is off 2023-10-03T18:55:16.487 INFO:teuthology.orchestra.console.smithi064:Power on 2023-10-03T18:55:16.487 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-03T18:55:16.494 INFO:teuthology.orchestra.console.smithi163:Power on 2023-10-03T18:55:16.494 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-03T18:55:16.509 DEBUG:teuthology.orchestra.console.smithi064:power on output: Chassis Power Control: Up/On 2023-10-03T18:55:16.509 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T18:55:16.517 DEBUG:teuthology.orchestra.console.smithi163:power on output: Chassis Power Control: Up/On 2023-10-03T18:55:16.518 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T18:55:16.532 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off 2023-10-03T18:55:16.541 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off 2023-10-03T18:55:16.568 INFO:teuthology.orchestra.console.smithi072:Power on 2023-10-03T18:55:16.568 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-03T18:55:16.575 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off 2023-10-03T18:55:16.590 DEBUG:teuthology.orchestra.console.smithi072:power on output: Chassis Power Control: Up/On 2023-10-03T18:55:16.590 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T18:55:16.614 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off 2023-10-03T18:55:20.478 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T18:55:20.533 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T18:55:20.542 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T18:55:20.577 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T18:55:20.587 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is on 2023-10-03T18:55:20.615 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T18:55:20.642 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2023-10-03T18:55:20.651 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on 2023-10-03T18:55:20.688 INFO:teuthology.orchestra.console.smithi019:Power on completed 2023-10-03T18:55:20.712 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is on 2023-10-03T18:55:20.724 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off 2023-10-03T18:55:20.743 INFO:teuthology.orchestra.console.smithi064:Power on completed 2023-10-03T18:55:20.752 INFO:teuthology.orchestra.console.smithi163:Power on completed 2023-10-03T18:55:20.789 INFO:teuthology.provision.fog.smithi019:Waiting for deploy to finish 2023-10-03T18:55:20.790 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-10-03T18:55:20.813 INFO:teuthology.orchestra.console.smithi125:Power on completed 2023-10-03T18:55:20.844 INFO:teuthology.provision.fog.smithi064:Waiting for deploy to finish 2023-10-03T18:55:20.844 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-10-03T18:55:20.853 INFO:teuthology.provision.fog.smithi163:Waiting for deploy to finish 2023-10-03T18:55:20.853 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-03T18:55:20.914 INFO:teuthology.provision.fog.smithi125:Waiting for deploy to finish 2023-10-03T18:55:20.915 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-10-03T18:55:24.727 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T18:55:24.835 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2023-10-03T18:55:24.936 INFO:teuthology.orchestra.console.smithi072:Power on completed 2023-10-03T18:55:25.036 INFO:teuthology.provision.fog.smithi072:Waiting for deploy to finish 2023-10-03T18:55:25.037 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-10-03T18:55:35.958 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-10-03T18:55:35.979 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-10-03T18:55:35.987 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-03T18:55:36.034 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-10-03T18:55:40.214 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-10-03T18:55:51.122 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-03T18:55:51.123 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-10-03T18:55:51.124 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-10-03T18:55:51.149 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-10-03T18:55:55.354 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-10-03T18:56:06.270 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-10-03T18:56:06.272 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-03T18:56:06.273 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-10-03T18:56:06.277 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-10-03T18:56:10.518 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-10-03T18:56:21.414 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-03T18:56:21.415 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-10-03T18:56:21.416 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-10-03T18:56:21.421 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-10-03T18:56:25.650 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-10-03T18:56:36.540 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-10-03T18:56:36.541 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-10-03T18:56:36.542 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-10-03T18:56:36.542 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-03T18:56:40.764 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-10-03T18:56:51.654 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-10-03T18:56:51.660 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-10-03T18:56:51.668 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-03T18:56:51.670 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-10-03T18:56:55.878 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-10-03T18:57:06.758 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-10-03T18:57:06.759 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-10-03T18:57:06.760 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-10-03T18:57:06.765 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-03T18:57:10.986 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-10-03T18:57:21.854 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-10-03T18:57:21.856 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-03T18:57:21.857 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-10-03T18:57:21.858 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-10-03T18:57:26.082 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-10-03T18:57:36.946 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-10-03T18:57:36.947 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-10-03T18:57:36.951 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-03T18:57:36.953 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-10-03T18:57:41.164 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-10-03T18:57:52.046 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-03T18:57:52.047 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-10-03T18:57:52.048 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-10-03T18:57:52.049 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-10-03T18:57:56.249 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-10-03T18:58:07.130 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-10-03T18:58:07.131 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-03T18:58:07.132 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-10-03T18:58:07.133 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-10-03T18:58:11.342 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-10-03T18:58:22.214 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-10-03T18:58:22.216 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-03T18:58:22.217 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-10-03T18:58:22.217 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-10-03T18:58:22.293 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T18:58:22.423 ERROR:teuthology.orchestra.connection:Error authenticating with smithi019.front.sepia.ceph.com: Authentication failed. 2023-10-03T18:58:22.424 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-03T18:58:22.424 DEBUG:teuthology.orchestra.run.smithi019:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-03T18:58:22.425 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-10-03T18:58:26.417 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-10-03T18:58:37.290 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-03T18:58:37.293 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-10-03T18:58:37.294 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-10-03T18:58:37.369 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T18:58:37.371 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T18:58:41.487 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-10-03T18:58:52.368 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-03T18:58:52.428 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T18:58:55.742 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-10-03T18:58:55.743 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-10-03T18:58:56.546 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-10-03T18:59:01.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T18:59:01.745 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T18:59:04.798 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-10-03T18:59:04.830 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-10-03T18:59:10.800 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T18:59:10.832 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T18:59:10.842 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-10-03T18:59:11.603 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-10-03T18:59:13.850 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-10-03T18:59:13.882 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-10-03T18:59:16.844 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T18:59:19.853 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T18:59:19.883 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T18:59:19.898 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-10-03T18:59:22.906 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-10-03T18:59:22.938 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-10-03T18:59:25.899 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T18:59:26.657 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-10-03T18:59:28.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T18:59:28.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T18:59:28.958 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-10-03T18:59:31.962 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-10-03T18:59:34.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T18:59:37.963 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T18:59:38.010 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-10-03T18:59:41.707 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-10-03T18:59:41.756 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T18:59:44.012 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T18:59:47.070 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-10-03T18:59:53.072 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T18:59:56.126 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-10-03T19:00:00.250 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-10-03T19:00:02.127 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T19:00:05.182 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-10-03T19:00:06.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T19:00:09.306 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-10-03T19:00:09.467 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-10-03T19:00:11.184 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T19:00:14.586 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-10-03T19:00:14.587 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi019 2023-10-03T19:00:15.310 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T19:00:15.468 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T19:00:15.469 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-10-03T19:00:18.362 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-10-03T19:00:21.474 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T19:00:21.476 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-10-03T19:00:23.593 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2023-10-03T19:00:23.594 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T19:00:23.596 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.19 2023-10-03T19:00:24.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T19:00:27.418 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-10-03T19:00:27.477 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T19:00:27.479 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-10-03T19:00:28.942 WARNING:teuthology.provision.fog.smithi064:timed out 2023-10-03T19:00:32.598 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2023-10-03T19:00:32.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T19:00:32.835 DEBUG:teuthology.orchestra.run.smithi019:> true 2023-10-03T19:00:33.280 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi019.front.sepia.ceph.com' 2023-10-03T19:00:33.280 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-03T19:00:33.280 DEBUG:teuthology.orchestra.run.smithi019:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-03T19:00:33.327 INFO:teuthology.provision.fog.smithi019:Node is ready 2023-10-03T19:00:33.327 DEBUG:teuthology.orchestra.run.smithi019:> hostname 2023-10-03T19:00:33.375 INFO:teuthology.orchestra.run.smithi019.stdout:smithi019.front.sepia.ceph.com 2023-10-03T19:00:33.375 DEBUG:teuthology.orchestra.run.smithi019:> grep smithi019.front.sepia.ceph.com /etc/hosts 2023-10-03T19:00:33.419 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T19:00:33.423 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19 smithi019.front.sepia.ceph.com smithi019 2023-10-03T19:00:33.424 DEBUG:teuthology.orchestra.run.smithi019:> sudo hostname smithi019 2023-10-03T19:00:33.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T19:00:33.481 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-10-03T19:00:33.579 DEBUG:teuthology.orchestra.run.smithi019:> sudo sed -i -e 's/smithi019.front.sepia.ceph.com/smithi019/g' /etc/hosts 2023-10-03T19:00:33.594 DEBUG:teuthology.orchestra.run.smithi019:> sudo sed -i -e 's/172.21.15.19/172.21.15.19/g' /etc/hosts 2023-10-03T19:00:33.651 DEBUG:teuthology.orchestra.run.smithi019:> sudo sed -i -e 's/smithi019.front.sepia.ceph.com/smithi019/g' /etc/hostname 2023-10-03T19:00:33.708 DEBUG:teuthology.orchestra.run.smithi019:> sudo hostname smithi019 2023-10-03T19:00:33.763 DEBUG:teuthology.orchestra.run.smithi019:> cat /etc/os-release 2023-10-03T19:00:33.811 INFO:teuthology.orchestra.run.smithi019.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-10-03T19:00:33.812 INFO:teuthology.orchestra.run.smithi019.stdout:NAME="Ubuntu" 2023-10-03T19:00:33.812 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION_ID="22.04" 2023-10-03T19:00:33.812 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-10-03T19:00:33.812 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION_CODENAME=jammy 2023-10-03T19:00:33.812 INFO:teuthology.orchestra.run.smithi019.stdout:ID=ubuntu 2023-10-03T19:00:33.812 INFO:teuthology.orchestra.run.smithi019.stdout:ID_LIKE=debian 2023-10-03T19:00:33.812 INFO:teuthology.orchestra.run.smithi019.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-03T19:00:33.812 INFO:teuthology.orchestra.run.smithi019.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-03T19:00:33.812 INFO:teuthology.orchestra.run.smithi019.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-03T19:00:33.812 INFO:teuthology.orchestra.run.smithi019.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-03T19:00:33.812 INFO:teuthology.orchestra.run.smithi019.stdout:UBUNTU_CODENAME=jammy 2023-10-03T19:00:33.813 INFO:teuthology.provision.fog.smithi019:Deploy complete! 2023-10-03T19:00:33.814 DEBUG:teuthology.parallel:result is None 2023-10-03T19:00:34.945 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T19:00:35.187 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-03T19:00:35.188 DEBUG:teuthology.orchestra.run.smithi064:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-03T19:00:35.683 INFO:teuthology.provision.fog.smithi064:Node is ready 2023-10-03T19:00:35.683 DEBUG:teuthology.orchestra.run.smithi064:> hostname 2023-10-03T19:00:35.688 INFO:teuthology.orchestra.run.smithi064.stdout:smithi064.front.sepia.ceph.com 2023-10-03T19:00:35.688 DEBUG:teuthology.orchestra.run.smithi064:> grep smithi064.front.sepia.ceph.com /etc/hosts 2023-10-03T19:00:35.740 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64 smithi064.front.sepia.ceph.com smithi064 2023-10-03T19:00:35.740 DEBUG:teuthology.orchestra.run.smithi064:> sudo hostname smithi064 2023-10-03T19:00:35.976 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/smithi064.front.sepia.ceph.com/smithi064/g' /etc/hosts 2023-10-03T19:00:35.990 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/172.21.15.64/172.21.15.64/g' /etc/hosts 2023-10-03T19:00:36.051 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/smithi064.front.sepia.ceph.com/smithi064/g' /etc/hostname 2023-10-03T19:00:36.109 DEBUG:teuthology.orchestra.run.smithi064:> sudo hostname smithi064 2023-10-03T19:00:36.164 DEBUG:teuthology.orchestra.run.smithi064:> cat /etc/os-release 2023-10-03T19:00:36.211 INFO:teuthology.orchestra.run.smithi064.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-10-03T19:00:36.211 INFO:teuthology.orchestra.run.smithi064.stdout:NAME="Ubuntu" 2023-10-03T19:00:36.211 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_ID="22.04" 2023-10-03T19:00:36.211 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-10-03T19:00:36.211 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_CODENAME=jammy 2023-10-03T19:00:36.211 INFO:teuthology.orchestra.run.smithi064.stdout:ID=ubuntu 2023-10-03T19:00:36.211 INFO:teuthology.orchestra.run.smithi064.stdout:ID_LIKE=debian 2023-10-03T19:00:36.212 INFO:teuthology.orchestra.run.smithi064.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-03T19:00:36.212 INFO:teuthology.orchestra.run.smithi064.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-03T19:00:36.212 INFO:teuthology.orchestra.run.smithi064.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-03T19:00:36.212 INFO:teuthology.orchestra.run.smithi064.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-03T19:00:36.212 INFO:teuthology.orchestra.run.smithi064.stdout:UBUNTU_CODENAME=jammy 2023-10-03T19:00:36.212 INFO:teuthology.provision.fog.smithi064:Deploy complete! 2023-10-03T19:00:36.213 DEBUG:teuthology.parallel:result is None 2023-10-03T19:00:36.478 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-10-03T19:00:39.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T19:00:39.694 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-03T19:00:39.694 DEBUG:teuthology.orchestra.run.smithi125:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-03T19:00:40.353 INFO:teuthology.provision.fog.smithi125:Node is ready 2023-10-03T19:00:40.353 DEBUG:teuthology.orchestra.run.smithi125:> hostname 2023-10-03T19:00:40.405 INFO:teuthology.orchestra.run.smithi125.stdout:smithi125.front.sepia.ceph.com 2023-10-03T19:00:40.405 DEBUG:teuthology.orchestra.run.smithi125:> grep smithi125.front.sepia.ceph.com /etc/hosts 2023-10-03T19:00:40.453 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.15.125 smithi125.front.sepia.ceph.com smithi125 2023-10-03T19:00:40.454 DEBUG:teuthology.orchestra.run.smithi125:> sudo hostname smithi125 2023-10-03T19:00:40.559 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/smithi125.front.sepia.ceph.com/smithi125/g' /etc/hosts 2023-10-03T19:00:40.573 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/172.21.15.125/172.21.15.125/g' /etc/hosts 2023-10-03T19:00:40.629 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/smithi125.front.sepia.ceph.com/smithi125/g' /etc/hostname 2023-10-03T19:00:40.690 DEBUG:teuthology.orchestra.run.smithi125:> sudo hostname smithi125 2023-10-03T19:00:40.743 DEBUG:teuthology.orchestra.run.smithi125:> cat /etc/os-release 2023-10-03T19:00:40.788 INFO:teuthology.orchestra.run.smithi125.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-10-03T19:00:40.789 INFO:teuthology.orchestra.run.smithi125.stdout:NAME="Ubuntu" 2023-10-03T19:00:40.789 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_ID="22.04" 2023-10-03T19:00:40.789 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-10-03T19:00:40.789 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_CODENAME=jammy 2023-10-03T19:00:40.789 INFO:teuthology.orchestra.run.smithi125.stdout:ID=ubuntu 2023-10-03T19:00:40.789 INFO:teuthology.orchestra.run.smithi125.stdout:ID_LIKE=debian 2023-10-03T19:00:40.789 INFO:teuthology.orchestra.run.smithi125.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-03T19:00:40.789 INFO:teuthology.orchestra.run.smithi125.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-03T19:00:40.789 INFO:teuthology.orchestra.run.smithi125.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-03T19:00:40.790 INFO:teuthology.orchestra.run.smithi125.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-03T19:00:40.790 INFO:teuthology.orchestra.run.smithi125.stdout:UBUNTU_CODENAME=jammy 2023-10-03T19:00:40.790 INFO:teuthology.provision.fog.smithi125:Deploy complete! 2023-10-03T19:00:40.790 DEBUG:teuthology.parallel:result is None 2023-10-03T19:00:42.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T19:01:11.189 WARNING:teuthology.provision.fog.smithi163:timed out 2023-10-03T19:01:17.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T19:01:17.366 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-03T19:01:17.366 DEBUG:teuthology.orchestra.run.smithi163:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-03T19:01:17.821 INFO:teuthology.provision.fog.smithi163:Node is ready 2023-10-03T19:01:17.821 DEBUG:teuthology.orchestra.run.smithi163:> hostname 2023-10-03T19:01:17.871 INFO:teuthology.orchestra.run.smithi163.stdout:smithi163.front.sepia.ceph.com 2023-10-03T19:01:17.871 DEBUG:teuthology.orchestra.run.smithi163:> grep smithi163.front.sepia.ceph.com /etc/hosts 2023-10-03T19:01:17.917 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163 smithi163.front.sepia.ceph.com smithi163 2023-10-03T19:01:17.917 DEBUG:teuthology.orchestra.run.smithi163:> sudo hostname smithi163 2023-10-03T19:01:18.044 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/smithi163.front.sepia.ceph.com/smithi163/g' /etc/hosts 2023-10-03T19:01:18.057 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/172.21.15.163/172.21.15.163/g' /etc/hosts 2023-10-03T19:01:18.113 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/smithi163.front.sepia.ceph.com/smithi163/g' /etc/hostname 2023-10-03T19:01:18.174 DEBUG:teuthology.orchestra.run.smithi163:> sudo hostname smithi163 2023-10-03T19:01:18.228 DEBUG:teuthology.orchestra.run.smithi163:> cat /etc/os-release 2023-10-03T19:01:18.277 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-10-03T19:01:18.277 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="Ubuntu" 2023-10-03T19:01:18.277 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="22.04" 2023-10-03T19:01:18.277 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-10-03T19:01:18.277 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_CODENAME=jammy 2023-10-03T19:01:18.278 INFO:teuthology.orchestra.run.smithi163.stdout:ID=ubuntu 2023-10-03T19:01:18.278 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE=debian 2023-10-03T19:01:18.278 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-03T19:01:18.278 INFO:teuthology.orchestra.run.smithi163.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-03T19:01:18.278 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-03T19:01:18.278 INFO:teuthology.orchestra.run.smithi163.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-03T19:01:18.278 INFO:teuthology.orchestra.run.smithi163.stdout:UBUNTU_CODENAME=jammy 2023-10-03T19:01:18.278 INFO:teuthology.provision.fog.smithi163:Deploy complete! 2023-10-03T19:01:18.279 DEBUG:teuthology.parallel:result is None 2023-10-03T19:01:42.482 WARNING:teuthology.provision.fog.smithi072:timed out 2023-10-03T19:01:48.484 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T19:01:48.783 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-03T19:01:48.784 DEBUG:teuthology.orchestra.run.smithi072:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-03T19:01:49.335 INFO:teuthology.provision.fog.smithi072:Node is ready 2023-10-03T19:01:49.336 DEBUG:teuthology.orchestra.run.smithi072:> hostname 2023-10-03T19:01:49.340 INFO:teuthology.orchestra.run.smithi072.stdout:smithi072.front.sepia.ceph.com 2023-10-03T19:01:49.340 DEBUG:teuthology.orchestra.run.smithi072:> grep smithi072.front.sepia.ceph.com /etc/hosts 2023-10-03T19:01:49.388 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72 smithi072.front.sepia.ceph.com smithi072 2023-10-03T19:01:49.388 DEBUG:teuthology.orchestra.run.smithi072:> sudo hostname smithi072 2023-10-03T19:01:49.542 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i -e 's/smithi072.front.sepia.ceph.com/smithi072/g' /etc/hosts 2023-10-03T19:01:49.556 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i -e 's/172.21.15.72/172.21.15.72/g' /etc/hosts 2023-10-03T19:01:49.616 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i -e 's/smithi072.front.sepia.ceph.com/smithi072/g' /etc/hostname 2023-10-03T19:01:49.672 DEBUG:teuthology.orchestra.run.smithi072:> sudo hostname smithi072 2023-10-03T19:01:49.726 DEBUG:teuthology.orchestra.run.smithi072:> cat /etc/os-release 2023-10-03T19:01:49.772 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-10-03T19:01:49.772 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="Ubuntu" 2023-10-03T19:01:49.772 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="22.04" 2023-10-03T19:01:49.772 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-10-03T19:01:49.772 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_CODENAME=jammy 2023-10-03T19:01:49.773 INFO:teuthology.orchestra.run.smithi072.stdout:ID=ubuntu 2023-10-03T19:01:49.773 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE=debian 2023-10-03T19:01:49.773 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-03T19:01:49.773 INFO:teuthology.orchestra.run.smithi072.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-03T19:01:49.773 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-03T19:01:49.773 INFO:teuthology.orchestra.run.smithi072.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-03T19:01:49.773 INFO:teuthology.orchestra.run.smithi072.stdout:UBUNTU_CODENAME=jammy 2023-10-03T19:01:49.773 INFO:teuthology.provision.fog.smithi072:Deploy complete! 2023-10-03T19:01:49.774 DEBUG:teuthology.parallel:result is None 2023-10-03T19:01:50.123 INFO:teuthology.lock.ops:Checking smithi019.front.sepia.ceph.com 2023-10-03T19:01:50.123 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-03T19:01:50.147 INFO:teuthology.lock.ops:Checking smithi064.front.sepia.ceph.com 2023-10-03T19:01:50.147 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-03T19:01:50.182 INFO:teuthology.lock.ops:Checking smithi072.front.sepia.ceph.com 2023-10-03T19:01:50.182 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-03T19:01:50.214 INFO:teuthology.lock.ops:Checking smithi125.front.sepia.ceph.com 2023-10-03T19:01:50.214 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-03T19:01:50.239 INFO:teuthology.lock.ops:Checking smithi163.front.sepia.ceph.com 2023-10-03T19:01:50.239 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-03T19:01:50.256 INFO:teuthology.lock.ops:Updating [smithi019.front.sepia.ceph.com]: set os type and version on server 2023-10-03T19:01:50.257 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2023-10-03T19:01:50.257 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T19:01:50.334 DEBUG:teuthology.orchestra.run.smithi019:> true 2023-10-03T19:01:50.571 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi019.front.sepia.ceph.com' 2023-10-03T19:01:50.572 DEBUG:teuthology.orchestra.run.smithi019:> uname -m 2023-10-03T19:01:50.620 INFO:teuthology.orchestra.run.smithi019.stdout:x86_64 2023-10-03T19:01:50.620 DEBUG:teuthology.orchestra.run.smithi019:> cat /etc/os-release 2023-10-03T19:01:50.667 INFO:teuthology.orchestra.run.smithi019.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-10-03T19:01:50.668 INFO:teuthology.orchestra.run.smithi019.stdout:NAME="Ubuntu" 2023-10-03T19:01:50.668 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION_ID="22.04" 2023-10-03T19:01:50.668 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-10-03T19:01:50.668 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION_CODENAME=jammy 2023-10-03T19:01:50.668 INFO:teuthology.orchestra.run.smithi019.stdout:ID=ubuntu 2023-10-03T19:01:50.668 INFO:teuthology.orchestra.run.smithi019.stdout:ID_LIKE=debian 2023-10-03T19:01:50.669 INFO:teuthology.orchestra.run.smithi019.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-03T19:01:50.669 INFO:teuthology.orchestra.run.smithi019.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-03T19:01:50.669 INFO:teuthology.orchestra.run.smithi019.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-03T19:01:50.669 INFO:teuthology.orchestra.run.smithi019.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-03T19:01:50.669 INFO:teuthology.orchestra.run.smithi019.stdout:UBUNTU_CODENAME=jammy 2023-10-03T19:01:50.670 INFO:teuthology.lock.ops:Updating smithi019.front.sepia.ceph.com on lock server 2023-10-03T19:01:50.690 INFO:teuthology.lock.ops:Updating [smithi064.front.sepia.ceph.com]: set os type and version on server 2023-10-03T19:01:50.690 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi064.front.sepia.ceph.com' 2023-10-03T19:01:50.691 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T19:01:50.771 DEBUG:teuthology.orchestra.run.smithi064:> true 2023-10-03T19:01:50.990 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi064.front.sepia.ceph.com' 2023-10-03T19:01:50.990 DEBUG:teuthology.orchestra.run.smithi064:> uname -m 2023-10-03T19:01:51.038 INFO:teuthology.orchestra.run.smithi064.stdout:x86_64 2023-10-03T19:01:51.039 DEBUG:teuthology.orchestra.run.smithi064:> cat /etc/os-release 2023-10-03T19:01:51.086 INFO:teuthology.orchestra.run.smithi064.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-10-03T19:01:51.086 INFO:teuthology.orchestra.run.smithi064.stdout:NAME="Ubuntu" 2023-10-03T19:01:51.086 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_ID="22.04" 2023-10-03T19:01:51.086 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-10-03T19:01:51.086 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_CODENAME=jammy 2023-10-03T19:01:51.086 INFO:teuthology.orchestra.run.smithi064.stdout:ID=ubuntu 2023-10-03T19:01:51.086 INFO:teuthology.orchestra.run.smithi064.stdout:ID_LIKE=debian 2023-10-03T19:01:51.086 INFO:teuthology.orchestra.run.smithi064.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-03T19:01:51.087 INFO:teuthology.orchestra.run.smithi064.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-03T19:01:51.087 INFO:teuthology.orchestra.run.smithi064.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-03T19:01:51.087 INFO:teuthology.orchestra.run.smithi064.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-03T19:01:51.087 INFO:teuthology.orchestra.run.smithi064.stdout:UBUNTU_CODENAME=jammy 2023-10-03T19:01:51.087 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server 2023-10-03T19:01:51.106 INFO:teuthology.lock.ops:Updating [smithi072.front.sepia.ceph.com]: set os type and version on server 2023-10-03T19:01:51.106 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-10-03T19:01:51.106 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T19:01:51.181 DEBUG:teuthology.orchestra.run.smithi072:> true 2023-10-03T19:01:51.278 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-10-03T19:01:51.278 DEBUG:teuthology.orchestra.run.smithi072:> uname -m 2023-10-03T19:01:51.323 INFO:teuthology.orchestra.run.smithi072.stdout:x86_64 2023-10-03T19:01:51.323 DEBUG:teuthology.orchestra.run.smithi072:> cat /etc/os-release 2023-10-03T19:01:51.372 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-10-03T19:01:51.372 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="Ubuntu" 2023-10-03T19:01:51.372 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="22.04" 2023-10-03T19:01:51.372 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-10-03T19:01:51.372 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_CODENAME=jammy 2023-10-03T19:01:51.372 INFO:teuthology.orchestra.run.smithi072.stdout:ID=ubuntu 2023-10-03T19:01:51.372 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE=debian 2023-10-03T19:01:51.372 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-03T19:01:51.372 INFO:teuthology.orchestra.run.smithi072.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-03T19:01:51.373 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-03T19:01:51.373 INFO:teuthology.orchestra.run.smithi072.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-03T19:01:51.373 INFO:teuthology.orchestra.run.smithi072.stdout:UBUNTU_CODENAME=jammy 2023-10-03T19:01:51.373 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server 2023-10-03T19:01:51.398 INFO:teuthology.lock.ops:Updating [smithi125.front.sepia.ceph.com]: set os type and version on server 2023-10-03T19:01:51.398 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com' 2023-10-03T19:01:51.399 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T19:01:51.474 DEBUG:teuthology.orchestra.run.smithi125:> true 2023-10-03T19:01:51.590 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi125.front.sepia.ceph.com' 2023-10-03T19:01:51.590 DEBUG:teuthology.orchestra.run.smithi125:> uname -m 2023-10-03T19:01:51.635 INFO:teuthology.orchestra.run.smithi125.stdout:x86_64 2023-10-03T19:01:51.635 DEBUG:teuthology.orchestra.run.smithi125:> cat /etc/os-release 2023-10-03T19:01:51.683 INFO:teuthology.orchestra.run.smithi125.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-10-03T19:01:51.683 INFO:teuthology.orchestra.run.smithi125.stdout:NAME="Ubuntu" 2023-10-03T19:01:51.683 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_ID="22.04" 2023-10-03T19:01:51.683 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-10-03T19:01:51.684 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_CODENAME=jammy 2023-10-03T19:01:51.684 INFO:teuthology.orchestra.run.smithi125.stdout:ID=ubuntu 2023-10-03T19:01:51.684 INFO:teuthology.orchestra.run.smithi125.stdout:ID_LIKE=debian 2023-10-03T19:01:51.684 INFO:teuthology.orchestra.run.smithi125.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-03T19:01:51.684 INFO:teuthology.orchestra.run.smithi125.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-03T19:01:51.684 INFO:teuthology.orchestra.run.smithi125.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-03T19:01:51.684 INFO:teuthology.orchestra.run.smithi125.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-03T19:01:51.684 INFO:teuthology.orchestra.run.smithi125.stdout:UBUNTU_CODENAME=jammy 2023-10-03T19:01:51.684 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server 2023-10-03T19:01:51.706 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: set os type and version on server 2023-10-03T19:01:51.706 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2023-10-03T19:01:51.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T19:01:51.781 DEBUG:teuthology.orchestra.run.smithi163:> true 2023-10-03T19:01:51.994 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi163.front.sepia.ceph.com' 2023-10-03T19:01:51.994 DEBUG:teuthology.orchestra.run.smithi163:> uname -m 2023-10-03T19:01:52.044 INFO:teuthology.orchestra.run.smithi163.stdout:x86_64 2023-10-03T19:01:52.044 DEBUG:teuthology.orchestra.run.smithi163:> cat /etc/os-release 2023-10-03T19:01:52.092 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-10-03T19:01:52.093 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="Ubuntu" 2023-10-03T19:01:52.093 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="22.04" 2023-10-03T19:01:52.093 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-10-03T19:01:52.093 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_CODENAME=jammy 2023-10-03T19:01:52.093 INFO:teuthology.orchestra.run.smithi163.stdout:ID=ubuntu 2023-10-03T19:01:52.093 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE=debian 2023-10-03T19:01:52.093 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-03T19:01:52.093 INFO:teuthology.orchestra.run.smithi163.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-03T19:01:52.093 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-03T19:01:52.093 INFO:teuthology.orchestra.run.smithi163.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-03T19:01:52.094 INFO:teuthology.orchestra.run.smithi163.stdout:UBUNTU_CODENAME=jammy 2023-10-03T19:01:52.094 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2023-10-03T19:01:52.115 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-03T19:01:52.206 INFO:teuthology.dispatcher.supervisor:Running job 7409800 2023-10-03T19:01:52.207 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_choffman@teuthology --archive /home/teuthworker/archive/choffman-2023-10-03_18:32:29-fs:multiclient-wip-choffman-62793-distro-default-smithi/7409800 --name choffman-2023-10-03_18:32:29-fs:multiclient-wip-choffman-62793-distro-default-smithi --description fs:multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/mdtest} -- /home/teuthworker/archive/choffman-2023-10-03_18:32:29-fs:multiclient-wip-choffman-62793-distro-default-smithi/7409800/orig.config.yaml 2023-10-03T19:01:52.210 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/choffman-2023-10-03_18:32:29-fs:multiclient-wip-choffman-62793-distro-default-smithi/7409800 2023-10-03T19:01:52.210 INFO:teuthology.dispatcher.supervisor:Job PID: 2132452 2023-10-03T19:01:52.210 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-03T19:03:52.310 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-03T19:05:52.479 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-03T19:07:52.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-03T19:09:52.812 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-03T19:11:52.979 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-03T19:13:53.148 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-03T19:15:53.318 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-03T19:17:53.492 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-03T19:19:53.660 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-03T19:21:53.845 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-03T19:23:54.003 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-03T19:23:54.075 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-10-03T19:23:54.361 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-03T19:23:54.362 INFO:teuthology.nuke:Checking targets against current locks 2023-10-03T19:23:54.418 DEBUG:teuthology.nuke:shortname: smithi019 2023-10-03T19:23:54.418 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-03T19:23:54.437 DEBUG:teuthology.nuke:shortname: smithi064 2023-10-03T19:23:54.437 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-03T19:23:54.441 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi019.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/choffman-2023-10-03_18:32:29-fs:multiclient-wip-choffman-62793-distro-default-smithi/7409800', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-03 18:55:01.883931', 'locked_by': 'scheduled_choffman@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ1GPHrOm70Mt7B9udB1h2SeHlS0sQiy1j3q1QjKIReZnwjKsp4scICMP419nFIq+cXYGLUKHAu/IbxYBJwslK8='} 2023-10-03T19:23:54.469 DEBUG:teuthology.nuke:shortname: smithi072 2023-10-03T19:23:54.469 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-03T19:23:54.471 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi064.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/choffman-2023-10-03_18:32:29-fs:multiclient-wip-choffman-62793-distro-default-smithi/7409800', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-03 18:55:01.889615', 'locked_by': 'scheduled_choffman@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKOEDbZmSNmdsuKUT0EB4e4LOxi+XfoejbAQ/eGCorHbjTfTHYC67T8mZp5+nzM0mj2mIw0CtKwm5G61VFjnhtk='} 2023-10-03T19:23:54.496 INFO:teuthology.orchestra.console.smithi019:Power off 2023-10-03T19:23:54.496 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-03T19:23:54.507 DEBUG:teuthology.nuke:shortname: smithi125 2023-10-03T19:23:54.507 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-03T19:23:54.509 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi072.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/choffman-2023-10-03_18:32:29-fs:multiclient-wip-choffman-62793-distro-default-smithi/7409800', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-03 18:55:01.887453', 'locked_by': 'scheduled_choffman@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFsJAlCtLYZdfsKCzGUYbsmEz9J0iLMjNJ7SD42aq/0jEKmvXpge/DQKHzJju8IDVG/9omkK7nhRZ+2NDXbvy7M='} 2023-10-03T19:23:54.518 DEBUG:teuthology.orchestra.console.smithi019:power off output: Chassis Power Control: Down/Off 2023-10-03T19:23:54.518 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T19:23:54.545 INFO:teuthology.orchestra.console.smithi064:Power off 2023-10-03T19:23:54.545 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-03T19:23:54.551 DEBUG:teuthology.nuke:shortname: smithi163 2023-10-03T19:23:54.551 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-03T19:23:54.556 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is off 2023-10-03T19:23:54.564 DEBUG:teuthology.orchestra.console.smithi064:power off output: Chassis Power Control: Down/Off 2023-10-03T19:23:54.565 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T19:23:54.578 INFO:teuthology.orchestra.console.smithi072:Power off 2023-10-03T19:23:54.578 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-03T19:23:54.585 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi125.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/choffman-2023-10-03_18:32:29-fs:multiclient-wip-choffman-62793-distro-default-smithi/7409800', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-03 18:55:01.885946', 'locked_by': 'scheduled_choffman@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO4NQ+UcR1VEQTLcx9uMRHKKsbvoTgBIVnjNE5G9/XvHh4Kqs2T4gqUBxRo2d6fn1mJX6R8C6n8M1rK4NdxwWr4='} 2023-10-03T19:23:54.587 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi163.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/choffman-2023-10-03_18:32:29-fs:multiclient-wip-choffman-62793-distro-default-smithi/7409800', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-03 18:55:01.888541', 'locked_by': 'scheduled_choffman@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIH+WMFx1DXyeQVvkqJANPpX71CMFFSK/ArHGU5UeKcEzQIZFNKVwYi6GrelCR+AW873bLvHdEkIsvx9tqbmCZc='} 2023-10-03T19:23:54.591 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off 2023-10-03T19:23:54.598 DEBUG:teuthology.orchestra.console.smithi072:power off output: Chassis Power Control: Down/Off 2023-10-03T19:23:54.598 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T19:23:54.618 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off 2023-10-03T19:23:54.628 INFO:teuthology.orchestra.console.smithi125:Power off 2023-10-03T19:23:54.629 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-03T19:23:54.641 INFO:teuthology.orchestra.console.smithi163:Power off 2023-10-03T19:23:54.641 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-03T19:23:54.648 DEBUG:teuthology.orchestra.console.smithi125:power off output: Chassis Power Control: Down/Off 2023-10-03T19:23:54.648 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T19:23:54.657 INFO:teuthology.orchestra.console.smithi019:Power off completed 2023-10-03T19:23:54.660 DEBUG:teuthology.orchestra.console.smithi163:power off output: Chassis Power Control: Down/Off 2023-10-03T19:23:54.660 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T19:23:54.669 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off 2023-10-03T19:23:54.681 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off 2023-10-03T19:23:54.691 INFO:teuthology.orchestra.console.smithi064:Power off completed 2023-10-03T19:23:54.719 INFO:teuthology.orchestra.console.smithi072:Power off completed 2023-10-03T19:23:54.770 INFO:teuthology.orchestra.console.smithi125:Power off completed 2023-10-03T19:23:54.781 INFO:teuthology.orchestra.console.smithi163:Power off completed 2023-10-03T19:23:54.807 INFO:teuthology.lock.ops:unlocked: smithi019.front.sepia.ceph.com 2023-10-03T19:23:54.843 INFO:teuthology.lock.ops:unlocked: smithi064.front.sepia.ceph.com 2023-10-03T19:23:54.866 INFO:teuthology.lock.ops:unlocked: smithi072.front.sepia.ceph.com 2023-10-03T19:23:54.924 INFO:teuthology.lock.ops:unlocked: smithi163.front.sepia.ceph.com 2023-10-03T19:23:54.934 INFO:teuthology.lock.ops:unlocked: smithi125.front.sepia.ceph.com