2023-11-17T20:19:24.869 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-17T20:19:24.869 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-17T20:19:25.113 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa8fb222ca0>, signals=[15]) 2023-11-17T20:19:25.114 INFO:teuthology.lock.ops:Start node 'smithi031.front.sepia.ceph.com' reimaging 2023-11-17T20:19:25.114 INFO:teuthology.lock.ops:Updating [smithi031.front.sepia.ceph.com]: reset os type and version on server 2023-11-17T20:19:25.114 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server 2023-11-17T20:19:25.133 INFO:teuthology.lock.ops:Start node 'smithi066.front.sepia.ceph.com' reimaging 2023-11-17T20:19:25.134 INFO:teuthology.lock.ops:Updating [smithi066.front.sepia.ceph.com]: reset os type and version on server 2023-11-17T20:19:25.134 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server 2023-11-17T20:19:25.135 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /host {"name": "smithi031"} 2023-11-17T20:19:25.158 INFO:teuthology.lock.ops:Start node 'smithi077.front.sepia.ceph.com' reimaging 2023-11-17T20:19:25.158 INFO:teuthology.lock.ops:Updating [smithi077.front.sepia.ceph.com]: reset os type and version on server 2023-11-17T20:19:25.158 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server 2023-11-17T20:19:25.159 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /host {"name": "smithi066"} 2023-11-17T20:19:25.183 INFO:teuthology.lock.ops:Start node 'smithi111.front.sepia.ceph.com' reimaging 2023-11-17T20:19:25.183 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: reset os type and version on server 2023-11-17T20:19:25.184 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server 2023-11-17T20:19:25.184 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /host {"name": "smithi077"} 2023-11-17T20:19:25.200 INFO:teuthology.lock.ops:Start node 'smithi192.front.sepia.ceph.com' reimaging 2023-11-17T20:19:25.200 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: reset os type and version on server 2023-11-17T20:19:25.200 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2023-11-17T20:19:25.201 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /host {"name": "smithi111"} 2023-11-17T20:19:25.214 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-11-17T20:19:25.219 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /host {"name": "smithi192"} 2023-11-17T20:19:25.240 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-11-17T20:19:25.256 DEBUG:teuthology.provision.fog.smithi031:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-11-17T20:19:25.256 DEBUG:teuthology.provision.fog.smithi031:FOG request: PUT /host/136 {"imageID": 2} 2023-11-17T20:19:25.266 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-11-17T20:19:25.273 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-11-17T20:19:25.275 DEBUG:teuthology.provision.fog.smithi066:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-11-17T20:19:25.275 DEBUG:teuthology.provision.fog.smithi066:FOG request: PUT /host/171 {"imageID": 2} 2023-11-17T20:19:25.287 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-11-17T20:19:25.306 DEBUG:teuthology.provision.fog.smithi111:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-11-17T20:19:25.306 DEBUG:teuthology.provision.fog.smithi111:FOG request: PUT /host/216 {"imageID": 2} 2023-11-17T20:19:25.309 INFO:teuthology.provision.fog.smithi031:Scheduling deploy of ubuntu 20.04 2023-11-17T20:19:25.309 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-11-17T20:19:25.310 DEBUG:teuthology.provision.fog.smithi077:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-11-17T20:19:25.310 DEBUG:teuthology.provision.fog.smithi077:FOG request: PUT /host/182 {"imageID": 2} 2023-11-17T20:19:25.322 INFO:teuthology.provision.fog.smithi066:Scheduling deploy of ubuntu 20.04 2023-11-17T20:19:25.322 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-11-17T20:19:25.327 DEBUG:teuthology.provision.fog.smithi192:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-11-17T20:19:25.327 DEBUG:teuthology.provision.fog.smithi192:FOG request: PUT /host/297 {"imageID": 2} 2023-11-17T20:19:25.359 INFO:teuthology.provision.fog.smithi111:Scheduling deploy of ubuntu 20.04 2023-11-17T20:19:25.359 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-11-17T20:19:25.365 INFO:teuthology.provision.fog.smithi192:Scheduling deploy of ubuntu 20.04 2023-11-17T20:19:25.365 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-11-17T20:19:25.367 INFO:teuthology.provision.fog.smithi077:Scheduling deploy of ubuntu 20.04 2023-11-17T20:19:25.367 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-11-17T20:19:25.375 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /tasktype {"name": "deploy"} 2023-11-17T20:19:25.390 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /tasktype {"name": "deploy"} 2023-11-17T20:19:25.407 DEBUG:teuthology.provision.fog.smithi031:FOG request: POST /host/136/task {"taskTypeID": 1} 2023-11-17T20:19:25.416 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /tasktype {"name": "deploy"} 2023-11-17T20:19:25.422 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /tasktype {"name": "deploy"} 2023-11-17T20:19:25.427 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /tasktype {"name": "deploy"} 2023-11-17T20:19:25.430 DEBUG:teuthology.provision.fog.smithi066:FOG request: POST /host/171/task {"taskTypeID": 1} 2023-11-17T20:19:25.455 DEBUG:teuthology.provision.fog.smithi192:FOG request: POST /host/297/task {"taskTypeID": 1} 2023-11-17T20:19:25.457 DEBUG:teuthology.provision.fog.smithi111:FOG request: POST /host/216/task {"taskTypeID": 1} 2023-11-17T20:19:25.463 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-11-17T20:19:25.466 DEBUG:teuthology.provision.fog.smithi077:FOG request: POST /host/182/task {"taskTypeID": 1} 2023-11-17T20:19:25.481 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-11-17T20:19:25.504 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-11-17T20:19:25.511 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-11-17T20:19:25.514 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-11-17T20:19:25.563 INFO:teuthology.orchestra.console.smithi031:Power off 2023-11-17T20:19:25.564 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-17T20:19:25.578 INFO:teuthology.orchestra.console.smithi066:Power off 2023-11-17T20:19:25.579 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-17T20:19:25.591 DEBUG:teuthology.orchestra.console.smithi031:power off output: Chassis Power Control: Down/Off 2023-11-17T20:19:25.591 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-17T20:19:25.603 DEBUG:teuthology.orchestra.console.smithi066:power off output: Chassis Power Control: Down/Off 2023-11-17T20:19:25.603 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-17T20:19:25.612 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2023-11-17T20:19:25.626 INFO:teuthology.orchestra.console.smithi111:Power off 2023-11-17T20:19:25.626 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-17T20:19:25.638 INFO:teuthology.orchestra.console.smithi077:Power off 2023-11-17T20:19:25.638 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-17T20:19:25.647 INFO:teuthology.orchestra.console.smithi192:Power off 2023-11-17T20:19:25.648 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-17T20:19:25.654 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is on 2023-11-17T20:19:25.655 DEBUG:teuthology.orchestra.console.smithi111:power off output: Chassis Power Control: Down/Off 2023-11-17T20:19:25.655 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-17T20:19:25.661 DEBUG:teuthology.orchestra.console.smithi077:power off output: Chassis Power Control: Down/Off 2023-11-17T20:19:25.662 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-17T20:19:25.668 DEBUG:teuthology.orchestra.console.smithi192:power off output: Chassis Power Control: Down/Off 2023-11-17T20:19:25.669 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-17T20:19:25.676 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on 2023-11-17T20:19:25.682 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is on 2023-11-17T20:19:25.687 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off 2023-11-17T20:19:25.788 INFO:teuthology.orchestra.console.smithi192:Power off completed 2023-11-17T20:19:25.888 INFO:teuthology.orchestra.console.smithi192:Power on 2023-11-17T20:19:25.889 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-17T20:19:25.907 DEBUG:teuthology.orchestra.console.smithi192:power on output: Chassis Power Control: Up/On 2023-11-17T20:19:25.907 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-17T20:19:25.926 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off 2023-11-17T20:19:29.614 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-17T20:19:29.656 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-17T20:19:29.677 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-17T20:19:29.683 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-17T20:19:29.722 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2023-11-17T20:19:29.764 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is on 2023-11-17T20:19:29.784 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on 2023-11-17T20:19:29.791 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is on 2023-11-17T20:19:29.927 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-17T20:19:30.035 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off 2023-11-17T20:19:33.726 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-17T20:19:33.764 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-17T20:19:33.785 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-17T20:19:33.791 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-17T20:19:33.833 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2023-11-17T20:19:33.871 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is on 2023-11-17T20:19:33.892 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off 2023-11-17T20:19:33.899 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is off 2023-11-17T20:19:33.993 INFO:teuthology.orchestra.console.smithi111:Power off completed 2023-11-17T20:19:34.000 INFO:teuthology.orchestra.console.smithi077:Power off completed 2023-11-17T20:19:34.036 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-17T20:19:34.094 INFO:teuthology.orchestra.console.smithi111:Power on 2023-11-17T20:19:34.094 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-17T20:19:34.101 INFO:teuthology.orchestra.console.smithi077:Power on 2023-11-17T20:19:34.101 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-17T20:19:34.115 DEBUG:teuthology.orchestra.console.smithi111:power on output: Chassis Power Control: Up/On 2023-11-17T20:19:34.115 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-17T20:19:34.121 DEBUG:teuthology.orchestra.console.smithi077:power on output: Chassis Power Control: Up/On 2023-11-17T20:19:34.122 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-17T20:19:34.133 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off 2023-11-17T20:19:34.141 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is off 2023-11-17T20:19:34.205 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on 2023-11-17T20:19:34.306 INFO:teuthology.orchestra.console.smithi192:Power on completed 2023-11-17T20:19:34.406 INFO:teuthology.provision.fog.smithi192:Waiting for deploy to finish 2023-11-17T20:19:34.407 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-11-17T20:19:37.837 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-17T20:19:37.872 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-17T20:19:37.945 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off 2023-11-17T20:19:37.978 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is off 2023-11-17T20:19:38.046 INFO:teuthology.orchestra.console.smithi031:Power off completed 2023-11-17T20:19:38.079 INFO:teuthology.orchestra.console.smithi066:Power off completed 2023-11-17T20:19:38.134 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-17T20:19:38.142 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-17T20:19:38.148 INFO:teuthology.orchestra.console.smithi031:Power on 2023-11-17T20:19:38.148 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-17T20:19:38.170 DEBUG:teuthology.orchestra.console.smithi031:power on output: Chassis Power Control: Up/On 2023-11-17T20:19:38.170 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-17T20:19:38.179 INFO:teuthology.orchestra.console.smithi066:Power on 2023-11-17T20:19:38.180 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-17T20:19:38.189 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off 2023-11-17T20:19:38.198 DEBUG:teuthology.orchestra.console.smithi066:power on output: Chassis Power Control: Up/On 2023-11-17T20:19:38.198 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-17T20:19:38.216 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is off 2023-11-17T20:19:38.242 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off 2023-11-17T20:19:38.249 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is on 2023-11-17T20:19:38.350 INFO:teuthology.orchestra.console.smithi077:Power on completed 2023-11-17T20:19:38.451 INFO:teuthology.provision.fog.smithi077:Waiting for deploy to finish 2023-11-17T20:19:38.451 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-11-17T20:19:42.191 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-17T20:19:42.217 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-17T20:19:42.242 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-17T20:19:42.298 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off 2023-11-17T20:19:42.323 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is off 2023-11-17T20:19:42.348 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on 2023-11-17T20:19:42.449 INFO:teuthology.orchestra.console.smithi111:Power on completed 2023-11-17T20:19:42.550 INFO:teuthology.provision.fog.smithi111:Waiting for deploy to finish 2023-11-17T20:19:42.550 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-11-17T20:19:46.302 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-17T20:19:46.323 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-17T20:19:46.411 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2023-11-17T20:19:46.430 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is on 2023-11-17T20:19:46.512 INFO:teuthology.orchestra.console.smithi031:Power on completed 2023-11-17T20:19:46.531 INFO:teuthology.orchestra.console.smithi066:Power on completed 2023-11-17T20:19:46.613 INFO:teuthology.provision.fog.smithi031:Waiting for deploy to finish 2023-11-17T20:19:46.613 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-11-17T20:19:46.632 INFO:teuthology.provision.fog.smithi066:Waiting for deploy to finish 2023-11-17T20:19:46.632 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-11-17T20:19:49.606 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-11-17T20:19:53.642 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-11-17T20:19:57.746 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-11-17T20:20:01.802 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-11-17T20:20:01.828 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-11-17T20:20:04.856 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-11-17T20:20:08.838 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-11-17T20:20:12.950 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-11-17T20:20:17.038 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-11-17T20:20:17.054 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-11-17T20:20:20.077 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-11-17T20:20:24.033 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-11-17T20:20:28.147 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-11-17T20:20:32.238 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-11-17T20:20:32.242 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-11-17T20:20:35.291 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-11-17T20:20:39.226 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-11-17T20:20:43.343 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-11-17T20:20:47.438 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-11-17T20:20:47.443 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-11-17T20:20:50.474 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-11-17T20:20:54.411 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-11-17T20:20:58.549 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-11-17T20:21:02.666 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-11-17T20:21:02.672 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-11-17T20:21:05.718 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-11-17T20:21:09.626 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-11-17T20:21:13.804 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-11-17T20:21:17.898 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-11-17T20:21:17.900 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-11-17T20:21:20.958 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-11-17T20:21:24.827 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-11-17T20:21:29.044 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-11-17T20:21:33.205 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-11-17T20:21:33.206 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-11-17T20:21:36.353 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-11-17T20:21:40.103 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-11-17T20:21:44.344 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-11-17T20:21:49.280 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-11-17T20:21:49.337 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-11-17T20:21:51.726 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-11-17T20:21:55.397 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-11-17T20:22:19.938 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-11-17T20:22:29.702 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-11-17T20:22:29.750 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-11-17T20:22:29.761 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-11-17T20:22:30.789 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-11-17T20:22:45.978 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-11-17T20:22:47.571 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-11-17T20:22:47.649 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-11-17T20:22:47.698 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-11-17T20:22:47.708 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-11-17T20:23:05.134 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-11-17T20:23:06.356 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-11-17T20:23:06.529 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-11-17T20:23:06.549 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-11-17T20:23:06.595 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-11-17T20:23:23.803 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-11-17T20:23:25.308 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-11-17T20:23:25.528 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-11-17T20:23:25.532 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-11-17T20:23:25.606 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-11-17T20:23:39.562 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-11-17T20:23:41.809 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-11-17T20:23:43.874 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-11-17T20:23:44.062 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-11-17T20:23:44.113 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-11-17T20:23:55.146 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-11-17T20:23:57.128 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-11-17T20:24:00.972 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-11-17T20:24:01.382 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-11-17T20:24:01.438 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-11-17T20:24:10.429 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-11-17T20:24:12.404 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-11-17T20:24:16.274 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-11-17T20:24:18.178 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-11-17T20:24:18.264 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-11-17T20:24:25.686 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-11-17T20:24:27.661 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-11-17T20:24:31.509 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-11-17T20:24:34.326 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-11-17T20:24:34.585 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T20:24:34.606 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-11-17T20:24:37.666 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-11-17T20:24:40.930 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-11-17T20:24:42.908 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-11-17T20:24:43.668 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T20:24:46.722 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-11-17T20:24:46.757 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-11-17T20:24:46.969 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T20:24:47.217 ERROR:teuthology.orchestra.connection:Error authenticating with smithi077.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-11-17T20:24:49.843 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-11-17T20:24:52.724 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T20:24:55.778 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-11-17T20:24:56.130 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-11-17T20:24:58.109 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-11-17T20:25:01.779 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T20:25:04.834 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-11-17T20:25:05.054 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-11-17T20:25:10.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T20:25:11.331 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-11-17T20:25:13.310 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None 2023-11-17T20:25:13.493 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T20:25:13.890 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-11-17T20:25:16.546 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-11-17T20:25:19.891 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T20:25:20.245 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-11-17T20:25:20.409 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T20:25:22.547 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T20:25:22.946 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-11-17T20:25:23.490 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31 2023-11-17T20:25:25.602 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-11-17T20:25:25.858 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77 2023-11-17T20:25:26.542 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-11-17T20:25:28.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T20:25:29.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T20:25:31.603 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T20:25:31.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T20:25:32.002 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-11-17T20:25:32.546 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31 2023-11-17T20:25:34.658 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-11-17T20:25:34.914 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77 2023-11-17T20:25:38.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T20:25:38.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T20:25:40.659 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T20:25:40.915 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T20:25:41.602 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31 2023-11-17T20:25:41.701 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-11-17T20:25:43.714 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-11-17T20:25:43.970 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77 2023-11-17T20:25:47.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T20:25:49.715 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T20:25:49.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T20:25:50.658 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31 2023-11-17T20:25:52.770 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-11-17T20:25:56.322 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-11-17T20:25:56.659 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T20:25:56.897 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-11-17T20:25:58.771 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T20:25:59.714 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31 2023-11-17T20:26:01.826 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-11-17T20:26:02.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T20:26:05.378 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-11-17T20:26:05.716 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T20:26:07.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T20:26:08.354 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77 2023-11-17T20:26:10.882 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-11-17T20:26:11.380 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T20:26:12.065 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-17T20:26:12.065 DEBUG:teuthology.orchestra.run.smithi192:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-17T20:26:12.087 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-11-17T20:26:14.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T20:26:16.884 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T20:26:17.410 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77 2023-11-17T20:26:19.938 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-11-17T20:26:23.411 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T20:26:25.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T20:26:26.466 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77 2023-11-17T20:26:27.237 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-11-17T20:26:28.994 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-11-17T20:26:32.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T20:26:32.667 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-17T20:26:32.667 DEBUG:teuthology.orchestra.run.smithi077:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-17T20:26:33.513 INFO:teuthology.provision.fog.smithi192:Node is ready 2023-11-17T20:26:33.513 DEBUG:teuthology.orchestra.run.smithi192:> hostname 2023-11-17T20:26:33.520 INFO:teuthology.orchestra.run.smithi192.stdout:smithi192.front.sepia.ceph.com 2023-11-17T20:26:33.520 DEBUG:teuthology.orchestra.run.smithi192:> grep smithi192.front.sepia.ceph.com /etc/hosts 2023-11-17T20:26:33.528 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.15.192 smithi192.front.sepia.ceph.com smithi192 2023-11-17T20:26:33.528 DEBUG:teuthology.orchestra.run.smithi192:> sudo hostname smithi192 2023-11-17T20:26:33.594 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/smithi192.front.sepia.ceph.com/smithi192/g' /etc/hosts 2023-11-17T20:26:33.612 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/172.21.15.192/172.21.15.192/g' /etc/hosts 2023-11-17T20:26:33.629 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/smithi192.front.sepia.ceph.com/smithi192/g' /etc/hostname 2023-11-17T20:26:33.685 DEBUG:teuthology.orchestra.run.smithi192:> sudo hostname smithi192 2023-11-17T20:26:33.696 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release 2023-11-17T20:26:33.702 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="Ubuntu" 2023-11-17T20:26:33.702 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-17T20:26:33.702 INFO:teuthology.orchestra.run.smithi192.stdout:ID=ubuntu 2023-11-17T20:26:33.703 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE=debian 2023-11-17T20:26:33.703 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-17T20:26:33.703 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="20.04" 2023-11-17T20:26:33.703 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-17T20:26:33.703 INFO:teuthology.orchestra.run.smithi192.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-17T20:26:33.703 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-17T20:26:33.703 INFO:teuthology.orchestra.run.smithi192.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-17T20:26:33.703 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_CODENAME=focal 2023-11-17T20:26:33.703 INFO:teuthology.orchestra.run.smithi192.stdout:UBUNTU_CODENAME=focal 2023-11-17T20:26:33.704 INFO:teuthology.provision.fog.smithi192:Deploy complete! 2023-11-17T20:26:33.705 DEBUG:teuthology.parallel:result is None 2023-11-17T20:26:34.996 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T20:26:38.050 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-11-17T20:26:42.358 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-11-17T20:26:44.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T20:26:47.106 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-11-17T20:26:53.107 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T20:26:53.212 INFO:teuthology.provision.fog.smithi077:Node is ready 2023-11-17T20:26:53.213 DEBUG:teuthology.orchestra.run.smithi077:> hostname 2023-11-17T20:26:53.220 INFO:teuthology.orchestra.run.smithi077.stdout:smithi077.front.sepia.ceph.com 2023-11-17T20:26:53.220 DEBUG:teuthology.orchestra.run.smithi077:> grep smithi077.front.sepia.ceph.com /etc/hosts 2023-11-17T20:26:53.228 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77 smithi077.front.sepia.ceph.com smithi077 2023-11-17T20:26:53.228 DEBUG:teuthology.orchestra.run.smithi077:> sudo hostname smithi077 2023-11-17T20:26:53.345 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i -e 's/smithi077.front.sepia.ceph.com/smithi077/g' /etc/hosts 2023-11-17T20:26:53.362 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i -e 's/172.21.15.77/172.21.15.77/g' /etc/hosts 2023-11-17T20:26:53.375 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i -e 's/smithi077.front.sepia.ceph.com/smithi077/g' /etc/hostname 2023-11-17T20:26:53.432 DEBUG:teuthology.orchestra.run.smithi077:> sudo hostname smithi077 2023-11-17T20:26:53.441 DEBUG:teuthology.orchestra.run.smithi077:> cat /etc/os-release 2023-11-17T20:26:53.447 INFO:teuthology.orchestra.run.smithi077.stdout:NAME="Ubuntu" 2023-11-17T20:26:53.447 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-17T20:26:53.447 INFO:teuthology.orchestra.run.smithi077.stdout:ID=ubuntu 2023-11-17T20:26:53.447 INFO:teuthology.orchestra.run.smithi077.stdout:ID_LIKE=debian 2023-11-17T20:26:53.447 INFO:teuthology.orchestra.run.smithi077.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-17T20:26:53.447 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_ID="20.04" 2023-11-17T20:26:53.447 INFO:teuthology.orchestra.run.smithi077.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-17T20:26:53.447 INFO:teuthology.orchestra.run.smithi077.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-17T20:26:53.448 INFO:teuthology.orchestra.run.smithi077.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-17T20:26:53.448 INFO:teuthology.orchestra.run.smithi077.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-17T20:26:53.448 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_CODENAME=focal 2023-11-17T20:26:53.448 INFO:teuthology.orchestra.run.smithi077.stdout:UBUNTU_CODENAME=focal 2023-11-17T20:26:53.448 INFO:teuthology.provision.fog.smithi077:Deploy complete! 2023-11-17T20:26:53.449 DEBUG:teuthology.parallel:result is None 2023-11-17T20:26:57.502 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-11-17T20:27:05.718 WARNING:teuthology.provision.fog.smithi031:timed out 2023-11-17T20:27:11.720 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T20:27:11.930 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-17T20:27:11.930 DEBUG:teuthology.orchestra.run.smithi031:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-17T20:27:12.479 INFO:teuthology.provision.fog.smithi031:Node is ready 2023-11-17T20:27:12.479 DEBUG:teuthology.orchestra.run.smithi031:> hostname 2023-11-17T20:27:12.486 INFO:teuthology.orchestra.run.smithi031.stdout:smithi031.front.sepia.ceph.com 2023-11-17T20:27:12.486 DEBUG:teuthology.orchestra.run.smithi031:> grep smithi031.front.sepia.ceph.com /etc/hosts 2023-11-17T20:27:12.535 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31 smithi031.front.sepia.ceph.com smithi031 2023-11-17T20:27:12.535 DEBUG:teuthology.orchestra.run.smithi031:> sudo hostname smithi031 2023-11-17T20:27:12.630 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/smithi031.front.sepia.ceph.com/smithi031/g' /etc/hosts 2023-11-17T20:27:12.643 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-11-17T20:27:12.647 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/172.21.15.31/172.21.15.31/g' /etc/hosts 2023-11-17T20:27:12.705 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/smithi031.front.sepia.ceph.com/smithi031/g' /etc/hostname 2023-11-17T20:27:12.715 DEBUG:teuthology.orchestra.run.smithi031:> sudo hostname smithi031 2023-11-17T20:27:12.726 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release 2023-11-17T20:27:12.779 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="Ubuntu" 2023-11-17T20:27:12.779 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-17T20:27:12.779 INFO:teuthology.orchestra.run.smithi031.stdout:ID=ubuntu 2023-11-17T20:27:12.779 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE=debian 2023-11-17T20:27:12.779 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-17T20:27:12.779 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="20.04" 2023-11-17T20:27:12.779 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-17T20:27:12.779 INFO:teuthology.orchestra.run.smithi031.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-17T20:27:12.780 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-17T20:27:12.780 INFO:teuthology.orchestra.run.smithi031.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-17T20:27:12.780 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_CODENAME=focal 2023-11-17T20:27:12.780 INFO:teuthology.orchestra.run.smithi031.stdout:UBUNTU_CODENAME=focal 2023-11-17T20:27:12.780 INFO:teuthology.provision.fog.smithi031:Deploy complete! 2023-11-17T20:27:12.781 DEBUG:teuthology.parallel:result is None 2023-11-17T20:27:27.763 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-11-17T20:27:42.873 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-11-17T20:27:53.109 WARNING:teuthology.provision.fog.smithi066:timed out 2023-11-17T20:27:57.987 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-11-17T20:27:59.110 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T20:27:59.313 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-17T20:27:59.313 DEBUG:teuthology.orchestra.run.smithi066:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-17T20:27:59.807 INFO:teuthology.provision.fog.smithi066:Node is ready 2023-11-17T20:27:59.807 DEBUG:teuthology.orchestra.run.smithi066:> hostname 2023-11-17T20:27:59.855 INFO:teuthology.orchestra.run.smithi066.stdout:smithi066.front.sepia.ceph.com 2023-11-17T20:27:59.856 DEBUG:teuthology.orchestra.run.smithi066:> grep smithi066.front.sepia.ceph.com /etc/hosts 2023-11-17T20:27:59.862 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66 smithi066.front.sepia.ceph.com smithi066 2023-11-17T20:27:59.862 DEBUG:teuthology.orchestra.run.smithi066:> sudo hostname smithi066 2023-11-17T20:27:59.942 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i -e 's/smithi066.front.sepia.ceph.com/smithi066/g' /etc/hosts 2023-11-17T20:27:59.959 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i -e 's/172.21.15.66/172.21.15.66/g' /etc/hosts 2023-11-17T20:28:00.018 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i -e 's/smithi066.front.sepia.ceph.com/smithi066/g' /etc/hostname 2023-11-17T20:28:00.029 DEBUG:teuthology.orchestra.run.smithi066:> sudo hostname smithi066 2023-11-17T20:28:00.039 DEBUG:teuthology.orchestra.run.smithi066:> cat /etc/os-release 2023-11-17T20:28:00.045 INFO:teuthology.orchestra.run.smithi066.stdout:NAME="Ubuntu" 2023-11-17T20:28:00.045 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-17T20:28:00.045 INFO:teuthology.orchestra.run.smithi066.stdout:ID=ubuntu 2023-11-17T20:28:00.045 INFO:teuthology.orchestra.run.smithi066.stdout:ID_LIKE=debian 2023-11-17T20:28:00.045 INFO:teuthology.orchestra.run.smithi066.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-17T20:28:00.045 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_ID="20.04" 2023-11-17T20:28:00.045 INFO:teuthology.orchestra.run.smithi066.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-17T20:28:00.045 INFO:teuthology.orchestra.run.smithi066.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-17T20:28:00.046 INFO:teuthology.orchestra.run.smithi066.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-17T20:28:00.046 INFO:teuthology.orchestra.run.smithi066.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-17T20:28:00.046 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_CODENAME=focal 2023-11-17T20:28:00.046 INFO:teuthology.orchestra.run.smithi066.stdout:UBUNTU_CODENAME=focal 2023-11-17T20:28:00.046 INFO:teuthology.provision.fog.smithi066:Deploy complete! 2023-11-17T20:28:00.047 DEBUG:teuthology.parallel:result is None 2023-11-17T20:28:13.072 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-11-17T20:28:28.166 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-11-17T20:28:43.236 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-11-17T20:28:58.307 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-11-17T20:29:13.362 DEBUG:teuthology.provision.fog.smithi111:FOG request: GET /task/active None 2023-11-17T20:29:13.415 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T20:29:16.482 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-11-17T20:29:22.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T20:29:25.538 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-11-17T20:29:31.539 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T20:29:34.594 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-11-17T20:29:40.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T20:29:43.650 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-11-17T20:29:49.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T20:29:52.706 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-11-17T20:29:58.707 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T20:30:01.766 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-11-17T20:30:07.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T20:30:10.818 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-11-17T20:30:16.819 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T20:30:19.878 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-11-17T20:30:25.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T20:30:28.962 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-11-17T20:30:34.963 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T20:30:53.282 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-11-17T20:30:59.284 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T20:31:02.342 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-11-17T20:31:08.343 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T20:31:09.756 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-17T20:31:09.756 DEBUG:teuthology.orchestra.run.smithi111:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-17T20:31:30.519 INFO:teuthology.provision.fog.smithi111:Node is ready 2023-11-17T20:31:30.520 DEBUG:teuthology.orchestra.run.smithi111:> hostname 2023-11-17T20:31:30.527 INFO:teuthology.orchestra.run.smithi111.stdout:smithi129 2023-11-17T20:31:30.527 DEBUG:teuthology.orchestra.run.smithi111:> grep smithi129 /etc/hosts 2023-11-17T20:31:30.583 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.129 smithi129 smithi129 2023-11-17T20:31:30.584 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname smithi111 2023-11-17T20:31:30.673 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/smithi129/smithi111/g' /etc/hosts 2023-11-17T20:31:30.692 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/172.21.15.129/172.21.15.111/g' /etc/hosts 2023-11-17T20:31:30.706 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/smithi129/smithi111/g' /etc/hostname 2023-11-17T20:31:30.763 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname smithi111 2023-11-17T20:31:30.773 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release 2023-11-17T20:31:30.779 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="Ubuntu" 2023-11-17T20:31:30.779 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-17T20:31:30.779 INFO:teuthology.orchestra.run.smithi111.stdout:ID=ubuntu 2023-11-17T20:31:30.779 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE=debian 2023-11-17T20:31:30.779 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-17T20:31:30.780 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="20.04" 2023-11-17T20:31:30.780 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-17T20:31:30.780 INFO:teuthology.orchestra.run.smithi111.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-17T20:31:30.780 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-17T20:31:30.780 INFO:teuthology.orchestra.run.smithi111.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-17T20:31:30.780 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_CODENAME=focal 2023-11-17T20:31:30.780 INFO:teuthology.orchestra.run.smithi111.stdout:UBUNTU_CODENAME=focal 2023-11-17T20:31:30.780 INFO:teuthology.provision.fog.smithi111:Deploy complete! 2023-11-17T20:31:30.781 DEBUG:teuthology.parallel:result is None 2023-11-17T20:31:31.275 INFO:teuthology.lock.ops:Checking smithi031.front.sepia.ceph.com 2023-11-17T20:31:31.275 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-17T20:31:31.300 INFO:teuthology.lock.ops:Checking smithi066.front.sepia.ceph.com 2023-11-17T20:31:31.300 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-17T20:31:31.319 INFO:teuthology.lock.ops:Checking smithi077.front.sepia.ceph.com 2023-11-17T20:31:31.319 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-17T20:31:31.341 INFO:teuthology.lock.ops:Checking smithi111.front.sepia.ceph.com 2023-11-17T20:31:31.342 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-17T20:31:31.366 INFO:teuthology.lock.ops:Checking smithi192.front.sepia.ceph.com 2023-11-17T20:31:31.366 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-17T20:31:31.394 INFO:teuthology.lock.ops:Updating [smithi031.front.sepia.ceph.com]: set os type and version on server 2023-11-17T20:31:31.395 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-11-17T20:31:31.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T20:31:31.449 DEBUG:teuthology.orchestra.run.smithi031:> true 2023-11-17T20:31:31.656 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-11-17T20:31:31.656 DEBUG:teuthology.orchestra.run.smithi031:> uname -m 2023-11-17T20:31:31.662 INFO:teuthology.orchestra.run.smithi031.stdout:x86_64 2023-11-17T20:31:31.662 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release 2023-11-17T20:31:31.669 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="Ubuntu" 2023-11-17T20:31:31.669 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-17T20:31:31.669 INFO:teuthology.orchestra.run.smithi031.stdout:ID=ubuntu 2023-11-17T20:31:31.669 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE=debian 2023-11-17T20:31:31.670 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-17T20:31:31.670 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="20.04" 2023-11-17T20:31:31.670 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-17T20:31:31.670 INFO:teuthology.orchestra.run.smithi031.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-17T20:31:31.670 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-17T20:31:31.670 INFO:teuthology.orchestra.run.smithi031.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-17T20:31:31.670 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_CODENAME=focal 2023-11-17T20:31:31.670 INFO:teuthology.orchestra.run.smithi031.stdout:UBUNTU_CODENAME=focal 2023-11-17T20:31:31.670 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server 2023-11-17T20:31:31.692 INFO:teuthology.lock.ops:Updating [smithi066.front.sepia.ceph.com]: set os type and version on server 2023-11-17T20:31:31.692 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2023-11-17T20:31:31.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T20:31:31.739 DEBUG:teuthology.orchestra.run.smithi066:> true 2023-11-17T20:31:31.947 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi066.front.sepia.ceph.com' 2023-11-17T20:31:31.947 DEBUG:teuthology.orchestra.run.smithi066:> uname -m 2023-11-17T20:31:31.994 INFO:teuthology.orchestra.run.smithi066.stdout:x86_64 2023-11-17T20:31:31.994 DEBUG:teuthology.orchestra.run.smithi066:> cat /etc/os-release 2023-11-17T20:31:32.001 INFO:teuthology.orchestra.run.smithi066.stdout:NAME="Ubuntu" 2023-11-17T20:31:32.001 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-17T20:31:32.001 INFO:teuthology.orchestra.run.smithi066.stdout:ID=ubuntu 2023-11-17T20:31:32.002 INFO:teuthology.orchestra.run.smithi066.stdout:ID_LIKE=debian 2023-11-17T20:31:32.002 INFO:teuthology.orchestra.run.smithi066.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-17T20:31:32.002 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_ID="20.04" 2023-11-17T20:31:32.002 INFO:teuthology.orchestra.run.smithi066.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-17T20:31:32.003 INFO:teuthology.orchestra.run.smithi066.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-17T20:31:32.003 INFO:teuthology.orchestra.run.smithi066.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-17T20:31:32.003 INFO:teuthology.orchestra.run.smithi066.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-17T20:31:32.003 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_CODENAME=focal 2023-11-17T20:31:32.003 INFO:teuthology.orchestra.run.smithi066.stdout:UBUNTU_CODENAME=focal 2023-11-17T20:31:32.004 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server 2023-11-17T20:31:32.033 INFO:teuthology.lock.ops:Updating [smithi077.front.sepia.ceph.com]: set os type and version on server 2023-11-17T20:31:32.034 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2023-11-17T20:31:32.034 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T20:31:32.083 DEBUG:teuthology.orchestra.run.smithi077:> true 2023-11-17T20:31:32.280 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi077.front.sepia.ceph.com' 2023-11-17T20:31:32.280 DEBUG:teuthology.orchestra.run.smithi077:> uname -m 2023-11-17T20:31:32.287 INFO:teuthology.orchestra.run.smithi077.stdout:x86_64 2023-11-17T20:31:32.287 DEBUG:teuthology.orchestra.run.smithi077:> cat /etc/os-release 2023-11-17T20:31:32.291 INFO:teuthology.orchestra.run.smithi077.stdout:NAME="Ubuntu" 2023-11-17T20:31:32.291 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-17T20:31:32.292 INFO:teuthology.orchestra.run.smithi077.stdout:ID=ubuntu 2023-11-17T20:31:32.292 INFO:teuthology.orchestra.run.smithi077.stdout:ID_LIKE=debian 2023-11-17T20:31:32.292 INFO:teuthology.orchestra.run.smithi077.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-17T20:31:32.292 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_ID="20.04" 2023-11-17T20:31:32.292 INFO:teuthology.orchestra.run.smithi077.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-17T20:31:32.292 INFO:teuthology.orchestra.run.smithi077.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-17T20:31:32.292 INFO:teuthology.orchestra.run.smithi077.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-17T20:31:32.292 INFO:teuthology.orchestra.run.smithi077.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-17T20:31:32.292 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_CODENAME=focal 2023-11-17T20:31:32.292 INFO:teuthology.orchestra.run.smithi077.stdout:UBUNTU_CODENAME=focal 2023-11-17T20:31:32.293 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server 2023-11-17T20:31:32.317 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: set os type and version on server 2023-11-17T20:31:32.317 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2023-11-17T20:31:32.317 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T20:31:32.366 DEBUG:teuthology.orchestra.run.smithi111:> true 2023-11-17T20:31:32.496 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi111.front.sepia.ceph.com' 2023-11-17T20:31:32.496 DEBUG:teuthology.orchestra.run.smithi111:> uname -m 2023-11-17T20:31:32.502 INFO:teuthology.orchestra.run.smithi111.stdout:x86_64 2023-11-17T20:31:32.502 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release 2023-11-17T20:31:32.508 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="Ubuntu" 2023-11-17T20:31:32.508 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-17T20:31:32.509 INFO:teuthology.orchestra.run.smithi111.stdout:ID=ubuntu 2023-11-17T20:31:32.509 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE=debian 2023-11-17T20:31:32.509 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-17T20:31:32.509 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="20.04" 2023-11-17T20:31:32.509 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-17T20:31:32.509 INFO:teuthology.orchestra.run.smithi111.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-17T20:31:32.509 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-17T20:31:32.509 INFO:teuthology.orchestra.run.smithi111.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-17T20:31:32.509 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_CODENAME=focal 2023-11-17T20:31:32.509 INFO:teuthology.orchestra.run.smithi111.stdout:UBUNTU_CODENAME=focal 2023-11-17T20:31:32.510 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server 2023-11-17T20:31:32.525 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: set os type and version on server 2023-11-17T20:31:32.525 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-11-17T20:31:32.526 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T20:31:32.575 DEBUG:teuthology.orchestra.run.smithi192:> true 2023-11-17T20:31:32.776 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-11-17T20:31:32.776 DEBUG:teuthology.orchestra.run.smithi192:> uname -m 2023-11-17T20:31:32.782 INFO:teuthology.orchestra.run.smithi192.stdout:x86_64 2023-11-17T20:31:32.782 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release 2023-11-17T20:31:32.787 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="Ubuntu" 2023-11-17T20:31:32.787 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-17T20:31:32.787 INFO:teuthology.orchestra.run.smithi192.stdout:ID=ubuntu 2023-11-17T20:31:32.787 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE=debian 2023-11-17T20:31:32.787 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-17T20:31:32.788 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="20.04" 2023-11-17T20:31:32.788 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-17T20:31:32.788 INFO:teuthology.orchestra.run.smithi192.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-17T20:31:32.788 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-17T20:31:32.788 INFO:teuthology.orchestra.run.smithi192.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-17T20:31:32.788 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_CODENAME=focal 2023-11-17T20:31:32.788 INFO:teuthology.orchestra.run.smithi192.stdout:UBUNTU_CODENAME=focal 2023-11-17T20:31:32.788 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2023-11-17T20:31:32.808 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-17T20:31:32.906 INFO:teuthology.dispatcher.supervisor:Running job 7461384 2023-11-17T20:31:32.906 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-11-17_14:22:05-upgrade:octopus-x-quincy-distro-default-smithi/7461384 --name teuthology-2023-11-17_14:22:05-upgrade:octopus-x-quincy-distro-default-smithi --description upgrade:octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/bluestore-hybrid 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-quincy 7-final-workload mon_election/connectivity thrashosds-health ubuntu_20.04} -- /home/teuthworker/archive/teuthology-2023-11-17_14:22:05-upgrade:octopus-x-quincy-distro-default-smithi/7461384/orig.config.yaml 2023-11-17T20:31:32.910 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-11-17_14:22:05-upgrade:octopus-x-quincy-distro-default-smithi/7461384 2023-11-17T20:31:32.910 INFO:teuthology.dispatcher.supervisor:Job PID: 72115 2023-11-17T20:31:32.911 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-17T20:33:32.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-17T20:35:18.432 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-11-17T20:35:18.432 DEBUG:teuthology.task.console_log:Killing console logger for smithi031 2023-11-17T20:35:18.433 ERROR:teuthology.dispatcher.supervisor:run_with_watchdog had an unhandled exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/dispatcher/supervisor.py", line 158, in run_job run_with_watchdog(p, job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/dispatcher/supervisor.py", line 339, in run_with_watchdog time.sleep(teuth_config.watchdog_interval) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/lib/python3.8/site-packages/gevent/hub.py", line 166, in sleep hub.wait(t) File "src/gevent/_hub_primitives.py", line 46, in gevent._gevent_c_hub_primitives.WaitOperationsGreenlet.wait File "src/gevent/_hub_primitives.py", line 55, in gevent._gevent_c_hub_primitives.WaitOperationsGreenlet.wait File "src/gevent/_waiter.py", line 154, in gevent._gevent_c_waiter.Waiter.get File "src/gevent/_greenlet_primitives.py", line 61, in gevent._gevent_c_greenlet_primitives.SwitchOutGreenletWithLoop.switch File "src/gevent/_greenlet_primitives.py", line 61, in gevent._gevent_c_greenlet_primitives.SwitchOutGreenletWithLoop.switch File "src/gevent/_greenlet_primitives.py", line 65, in gevent._gevent_c_greenlet_primitives.SwitchOutGreenletWithLoop.switch File "src/gevent/_gevent_c_greenlet_primitives.pxd", line 35, in gevent._gevent_c_greenlet_primitives._greenlet_switch psutil.NoSuchProcess: psutil.NoSuchProcess process no longer exists (pid=6545) 2023-11-17T20:35:18.543 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/dispatcher/supervisor.py", line 68, in main return run_job( File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/dispatcher/supervisor.py", line 158, in run_job run_with_watchdog(p, job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/dispatcher/supervisor.py", line 339, in run_with_watchdog time.sleep(teuth_config.watchdog_interval) File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/lib/python3.8/site-packages/gevent/hub.py", line 166, in sleep hub.wait(t) File "src/gevent/_hub_primitives.py", line 46, in gevent._gevent_c_hub_primitives.WaitOperationsGreenlet.wait File "src/gevent/_hub_primitives.py", line 55, in gevent._gevent_c_hub_primitives.WaitOperationsGreenlet.wait File "src/gevent/_waiter.py", line 154, in gevent._gevent_c_waiter.Waiter.get File "src/gevent/_greenlet_primitives.py", line 61, in gevent._gevent_c_greenlet_primitives.SwitchOutGreenletWithLoop.switch File "src/gevent/_greenlet_primitives.py", line 61, in gevent._gevent_c_greenlet_primitives.SwitchOutGreenletWithLoop.switch File "src/gevent/_greenlet_primitives.py", line 65, in gevent._gevent_c_greenlet_primitives.SwitchOutGreenletWithLoop.switch File "src/gevent/_gevent_c_greenlet_primitives.pxd", line 35, in gevent._gevent_c_greenlet_primitives._greenlet_switch psutil.NoSuchProcess: psutil.NoSuchProcess process no longer exists (pid=6545)