2023-10-17T17:25:49.844 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-17T17:25:49.846 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T17:25:50.029 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f0c405fd670>, signals=[15]) 2023-10-17T17:25:50.031 INFO:teuthology.lock.ops:Start node 'smithi003.front.sepia.ceph.com' reimaging 2023-10-17T17:25:50.031 INFO:teuthology.lock.ops:Updating [smithi003.front.sepia.ceph.com]: reset os type and version on server 2023-10-17T17:25:50.032 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server 2023-10-17T17:25:50.057 INFO:teuthology.lock.ops:Start node 'smithi131.front.sepia.ceph.com' reimaging 2023-10-17T17:25:50.058 INFO:teuthology.lock.ops:Updating [smithi131.front.sepia.ceph.com]: reset os type and version on server 2023-10-17T17:25:50.058 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server 2023-10-17T17:25:50.059 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /host {"name": "smithi003"} 2023-10-17T17:25:50.081 INFO:teuthology.lock.ops:Start node 'smithi167.front.sepia.ceph.com' reimaging 2023-10-17T17:25:50.082 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: reset os type and version on server 2023-10-17T17:25:50.082 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2023-10-17T17:25:50.084 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /host {"name": "smithi131"} 2023-10-17T17:25:50.107 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /host {"name": "smithi167"} 2023-10-17T17:25:50.138 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-10-17T17:25:50.155 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-10-17T17:25:50.170 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-10-17T17:25:50.184 DEBUG:teuthology.provision.fog.smithi003:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-10-17T17:25:50.184 DEBUG:teuthology.provision.fog.smithi003:FOG request: PUT /host/109 {"imageID": 2} 2023-10-17T17:25:50.197 DEBUG:teuthology.provision.fog.smithi131:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-10-17T17:25:50.197 DEBUG:teuthology.provision.fog.smithi131:FOG request: PUT /host/236 {"imageID": 2} 2023-10-17T17:25:50.216 DEBUG:teuthology.provision.fog.smithi167:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-10-17T17:25:50.216 DEBUG:teuthology.provision.fog.smithi167:FOG request: PUT /host/272 {"imageID": 2} 2023-10-17T17:25:50.229 INFO:teuthology.provision.fog.smithi003:Scheduling deploy of ubuntu 20.04 2023-10-17T17:25:50.229 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-17T17:25:50.247 INFO:teuthology.provision.fog.smithi131:Scheduling deploy of ubuntu 20.04 2023-10-17T17:25:50.247 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None 2023-10-17T17:25:50.263 INFO:teuthology.provision.fog.smithi167:Scheduling deploy of ubuntu 20.04 2023-10-17T17:25:50.263 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-10-17T17:25:50.290 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /tasktype {"name": "deploy"} 2023-10-17T17:25:50.304 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /tasktype {"name": "deploy"} 2023-10-17T17:25:50.312 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /tasktype {"name": "deploy"} 2023-10-17T17:25:50.328 DEBUG:teuthology.provision.fog.smithi003:FOG request: POST /host/109/task {"taskTypeID": 1} 2023-10-17T17:25:50.343 DEBUG:teuthology.provision.fog.smithi131:FOG request: POST /host/236/task {"taskTypeID": 1} 2023-10-17T17:25:50.349 DEBUG:teuthology.provision.fog.smithi167:FOG request: POST /host/272/task {"taskTypeID": 1} 2023-10-17T17:25:50.403 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None 2023-10-17T17:25:50.410 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-17T17:25:50.421 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-10-17T17:25:50.516 INFO:teuthology.orchestra.console.smithi003:Power off 2023-10-17T17:25:50.517 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-17T17:25:50.532 INFO:teuthology.orchestra.console.smithi131:Power off 2023-10-17T17:25:50.532 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-17T17:25:50.543 INFO:teuthology.orchestra.console.smithi167:Power off 2023-10-17T17:25:50.544 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-17T17:25:50.562 DEBUG:teuthology.orchestra.console.smithi131:power off output: Chassis Power Control: Down/Off 2023-10-17T17:25:50.562 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-17T17:25:50.570 DEBUG:teuthology.orchestra.console.smithi003:power off output: Chassis Power Control: Down/Off 2023-10-17T17:25:50.571 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-17T17:25:50.577 DEBUG:teuthology.orchestra.console.smithi167:power off output: Chassis Power Control: Down/Off 2023-10-17T17:25:50.578 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-17T17:25:50.588 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is on 2023-10-17T17:25:50.594 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is on 2023-10-17T17:25:50.601 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on 2023-10-17T17:25:54.593 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-17T17:25:54.599 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-17T17:25:54.606 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-17T17:25:54.702 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is on 2023-10-17T17:25:54.707 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is on 2023-10-17T17:25:54.715 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on 2023-10-17T17:25:58.706 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-17T17:25:58.713 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-17T17:25:58.720 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-17T17:25:58.816 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is off 2023-10-17T17:25:58.822 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is on 2023-10-17T17:25:58.829 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on 2023-10-17T17:25:58.917 INFO:teuthology.orchestra.console.smithi131:Power off completed 2023-10-17T17:25:59.018 INFO:teuthology.orchestra.console.smithi131:Power on 2023-10-17T17:25:59.019 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-17T17:25:59.042 DEBUG:teuthology.orchestra.console.smithi131:power on output: Chassis Power Control: Up/On 2023-10-17T17:25:59.042 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-17T17:25:59.068 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is off 2023-10-17T17:26:02.827 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-17T17:26:02.835 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-17T17:26:02.937 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is off 2023-10-17T17:26:02.943 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off 2023-10-17T17:26:03.038 INFO:teuthology.orchestra.console.smithi003:Power off completed 2023-10-17T17:26:03.045 INFO:teuthology.orchestra.console.smithi167:Power off completed 2023-10-17T17:26:03.069 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-17T17:26:03.139 INFO:teuthology.orchestra.console.smithi003:Power on 2023-10-17T17:26:03.139 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-17T17:26:03.146 INFO:teuthology.orchestra.console.smithi167:Power on 2023-10-17T17:26:03.147 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-17T17:26:03.162 DEBUG:teuthology.orchestra.console.smithi003:power on output: Chassis Power Control: Up/On 2023-10-17T17:26:03.163 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-17T17:26:03.174 DEBUG:teuthology.orchestra.console.smithi167:power on output: Chassis Power Control: Up/On 2023-10-17T17:26:03.175 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-17T17:26:03.183 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is off 2023-10-17T17:26:03.188 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is off 2023-10-17T17:26:03.196 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off 2023-10-17T17:26:07.187 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-17T17:26:07.195 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-17T17:26:07.200 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-17T17:26:07.297 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is on 2023-10-17T17:26:07.302 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is on 2023-10-17T17:26:07.309 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off 2023-10-17T17:26:07.398 INFO:teuthology.orchestra.console.smithi131:Power on completed 2023-10-17T17:26:07.403 INFO:teuthology.orchestra.console.smithi003:Power on completed 2023-10-17T17:26:07.500 INFO:teuthology.provision.fog.smithi131:Waiting for deploy to finish 2023-10-17T17:26:07.500 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None 2023-10-17T17:26:07.504 INFO:teuthology.provision.fog.smithi003:Waiting for deploy to finish 2023-10-17T17:26:07.505 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-17T17:26:11.310 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-17T17:26:11.538 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on 2023-10-17T17:26:11.639 INFO:teuthology.orchestra.console.smithi167:Power on completed 2023-10-17T17:26:11.740 INFO:teuthology.provision.fog.smithi167:Waiting for deploy to finish 2023-10-17T17:26:11.740 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-10-17T17:26:22.578 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-17T17:26:22.580 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None 2023-10-17T17:26:26.806 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-10-17T17:26:37.651 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-17T17:26:37.652 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None 2023-10-17T17:26:41.881 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-10-17T17:26:52.734 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-17T17:26:52.736 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None 2023-10-17T17:26:56.942 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-10-17T17:27:07.806 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-17T17:27:07.808 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None 2023-10-17T17:27:11.998 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-10-17T17:27:22.870 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-17T17:27:22.872 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None 2023-10-17T17:27:27.054 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-10-17T17:27:37.934 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-17T17:27:37.936 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None 2023-10-17T17:27:42.110 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-10-17T17:27:53.002 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None 2023-10-17T17:27:53.003 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-17T17:27:57.166 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-10-17T17:28:08.078 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-17T17:28:08.080 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None 2023-10-17T17:28:12.224 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-10-17T17:28:23.146 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-17T17:28:23.148 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None 2023-10-17T17:28:27.282 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-10-17T17:28:38.210 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-17T17:28:38.211 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None 2023-10-17T17:28:42.342 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-10-17T17:28:53.276 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-17T17:28:53.278 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None 2023-10-17T17:28:57.414 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-10-17T17:29:08.346 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None 2023-10-17T17:29:08.349 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-17T17:29:12.486 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-10-17T17:29:23.418 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None 2023-10-17T17:29:23.420 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-17T17:29:27.546 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-10-17T17:29:38.486 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None 2023-10-17T17:29:38.487 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-17T17:29:38.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T17:29:38.555 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T17:29:38.675 ERROR:teuthology.orchestra.connection:Error authenticating with smithi003.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-10-17T17:29:42.609 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-10-17T17:29:53.018 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-10-17T17:29:57.114 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131 2023-10-17T17:29:57.669 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-10-17T17:29:59.020 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T17:30:02.078 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-10-17T17:30:03.116 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T17:30:06.170 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131 2023-10-17T17:30:08.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T17:30:11.162 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-10-17T17:30:12.171 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T17:30:12.723 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None 2023-10-17T17:30:12.777 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T17:30:15.230 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131 2023-10-17T17:30:17.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T17:30:20.222 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-10-17T17:30:21.232 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T17:30:24.282 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131 2023-10-17T17:30:26.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T17:30:29.274 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-10-17T17:30:30.284 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T17:30:31.166 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-10-17T17:30:33.338 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131 2023-10-17T17:30:35.275 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T17:30:37.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T17:30:39.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T17:30:40.218 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-10-17T17:30:46.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T17:30:49.274 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-10-17T17:30:55.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T17:30:58.334 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-10-17T17:31:04.336 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T17:31:07.390 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-10-17T17:31:11.538 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-17T17:31:11.539 DEBUG:teuthology.orchestra.run.smithi131:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-17T17:31:13.392 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T17:31:32.325 INFO:teuthology.provision.fog.smithi131:Node is ready 2023-10-17T17:31:32.325 DEBUG:teuthology.orchestra.run.smithi131:> hostname 2023-10-17T17:31:32.332 INFO:teuthology.orchestra.run.smithi131.stdout:smithi131.front.sepia.ceph.com 2023-10-17T17:31:32.333 DEBUG:teuthology.orchestra.run.smithi131:> grep smithi131.front.sepia.ceph.com /etc/hosts 2023-10-17T17:31:32.340 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.15.131 smithi131.front.sepia.ceph.com smithi131 2023-10-17T17:31:32.340 DEBUG:teuthology.orchestra.run.smithi131:> sudo hostname smithi131 2023-10-17T17:31:32.480 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i -e 's/smithi131.front.sepia.ceph.com/smithi131/g' /etc/hosts 2023-10-17T17:31:32.496 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i -e 's/172.21.15.131/172.21.15.131/g' /etc/hosts 2023-10-17T17:31:32.511 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i -e 's/smithi131.front.sepia.ceph.com/smithi131/g' /etc/hostname 2023-10-17T17:31:32.570 DEBUG:teuthology.orchestra.run.smithi131:> sudo hostname smithi131 2023-10-17T17:31:32.579 DEBUG:teuthology.orchestra.run.smithi131:> cat /etc/os-release 2023-10-17T17:31:32.584 INFO:teuthology.orchestra.run.smithi131.stdout:NAME="Ubuntu" 2023-10-17T17:31:32.585 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-17T17:31:32.585 INFO:teuthology.orchestra.run.smithi131.stdout:ID=ubuntu 2023-10-17T17:31:32.585 INFO:teuthology.orchestra.run.smithi131.stdout:ID_LIKE=debian 2023-10-17T17:31:32.585 INFO:teuthology.orchestra.run.smithi131.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-17T17:31:32.585 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_ID="20.04" 2023-10-17T17:31:32.586 INFO:teuthology.orchestra.run.smithi131.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-17T17:31:32.586 INFO:teuthology.orchestra.run.smithi131.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-17T17:31:32.586 INFO:teuthology.orchestra.run.smithi131.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-17T17:31:32.586 INFO:teuthology.orchestra.run.smithi131.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-17T17:31:32.587 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_CODENAME=focal 2023-10-17T17:31:32.587 INFO:teuthology.orchestra.run.smithi131.stdout:UBUNTU_CODENAME=focal 2023-10-17T17:31:32.588 INFO:teuthology.provision.fog.smithi131:Deploy complete! 2023-10-17T17:31:32.589 DEBUG:teuthology.parallel:result is None 2023-10-17T17:31:35.278 WARNING:teuthology.provision.fog.smithi003:timed out 2023-10-17T17:31:41.280 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T17:31:41.479 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-17T17:31:41.479 DEBUG:teuthology.orchestra.run.smithi003:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-17T17:31:41.949 INFO:teuthology.provision.fog.smithi003:Node is ready 2023-10-17T17:31:41.949 DEBUG:teuthology.orchestra.run.smithi003:> hostname 2023-10-17T17:31:41.955 INFO:teuthology.orchestra.run.smithi003.stdout:smithi003.front.sepia.ceph.com 2023-10-17T17:31:41.957 DEBUG:teuthology.orchestra.run.smithi003:> grep smithi003.front.sepia.ceph.com /etc/hosts 2023-10-17T17:31:41.963 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3 smithi003.front.sepia.ceph.com smithi003 2023-10-17T17:31:41.964 DEBUG:teuthology.orchestra.run.smithi003:> sudo hostname smithi003 2023-10-17T17:31:42.093 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/smithi003.front.sepia.ceph.com/smithi003/g' /etc/hosts 2023-10-17T17:31:42.109 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/172.21.15.3/172.21.15.3/g' /etc/hosts 2023-10-17T17:31:42.123 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/smithi003.front.sepia.ceph.com/smithi003/g' /etc/hostname 2023-10-17T17:31:42.138 DEBUG:teuthology.orchestra.run.smithi003:> sudo hostname smithi003 2023-10-17T17:31:42.196 DEBUG:teuthology.orchestra.run.smithi003:> cat /etc/os-release 2023-10-17T17:31:42.201 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="Ubuntu" 2023-10-17T17:31:42.201 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-17T17:31:42.202 INFO:teuthology.orchestra.run.smithi003.stdout:ID=ubuntu 2023-10-17T17:31:42.202 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE=debian 2023-10-17T17:31:42.202 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-17T17:31:42.202 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="20.04" 2023-10-17T17:31:42.203 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-17T17:31:42.203 INFO:teuthology.orchestra.run.smithi003.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-17T17:31:42.203 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-17T17:31:42.203 INFO:teuthology.orchestra.run.smithi003.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-17T17:31:42.203 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_CODENAME=focal 2023-10-17T17:31:42.204 INFO:teuthology.orchestra.run.smithi003.stdout:UBUNTU_CODENAME=focal 2023-10-17T17:31:42.204 INFO:teuthology.provision.fog.smithi003:Deploy complete! 2023-10-17T17:31:42.205 DEBUG:teuthology.parallel:result is None 2023-10-17T17:32:13.395 WARNING:teuthology.provision.fog.smithi167:timed out 2023-10-17T17:32:19.397 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T17:32:19.537 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-17T17:32:19.537 DEBUG:teuthology.orchestra.run.smithi167:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-17T17:32:20.010 INFO:teuthology.provision.fog.smithi167:Node is ready 2023-10-17T17:32:20.011 DEBUG:teuthology.orchestra.run.smithi167:> hostname 2023-10-17T17:32:20.017 INFO:teuthology.orchestra.run.smithi167.stdout:smithi167.front.sepia.ceph.com 2023-10-17T17:32:20.018 DEBUG:teuthology.orchestra.run.smithi167:> grep smithi167.front.sepia.ceph.com /etc/hosts 2023-10-17T17:32:20.025 INFO:teuthology.orchestra.run.smithi167.stdout:172.21.15.167 smithi167.front.sepia.ceph.com smithi167 2023-10-17T17:32:20.026 DEBUG:teuthology.orchestra.run.smithi167:> sudo hostname smithi167 2023-10-17T17:32:20.161 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/smithi167.front.sepia.ceph.com/smithi167/g' /etc/hosts 2023-10-17T17:32:20.176 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/172.21.15.167/172.21.15.167/g' /etc/hosts 2023-10-17T17:32:20.189 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/smithi167.front.sepia.ceph.com/smithi167/g' /etc/hostname 2023-10-17T17:32:20.249 DEBUG:teuthology.orchestra.run.smithi167:> sudo hostname smithi167 2023-10-17T17:32:20.258 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release 2023-10-17T17:32:20.264 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="Ubuntu" 2023-10-17T17:32:20.265 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-17T17:32:20.265 INFO:teuthology.orchestra.run.smithi167.stdout:ID=ubuntu 2023-10-17T17:32:20.265 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE=debian 2023-10-17T17:32:20.265 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-17T17:32:20.266 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="20.04" 2023-10-17T17:32:20.266 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-17T17:32:20.266 INFO:teuthology.orchestra.run.smithi167.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-17T17:32:20.266 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-17T17:32:20.267 INFO:teuthology.orchestra.run.smithi167.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-17T17:32:20.267 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_CODENAME=focal 2023-10-17T17:32:20.267 INFO:teuthology.orchestra.run.smithi167.stdout:UBUNTU_CODENAME=focal 2023-10-17T17:32:20.269 INFO:teuthology.provision.fog.smithi167:Deploy complete! 2023-10-17T17:32:20.270 DEBUG:teuthology.parallel:result is None 2023-10-17T17:32:20.576 INFO:teuthology.lock.ops:Checking smithi003.front.sepia.ceph.com 2023-10-17T17:32:20.577 INFO:teuthology.lock.ops:Checking smithi131.front.sepia.ceph.com 2023-10-17T17:32:20.577 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-17T17:32:20.614 INFO:teuthology.lock.ops:Checking smithi167.front.sepia.ceph.com 2023-10-17T17:32:20.614 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-17T17:32:20.640 INFO:teuthology.lock.ops:Updating [smithi003.front.sepia.ceph.com]: set os type and version on server 2023-10-17T17:32:20.640 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com' 2023-10-17T17:32:20.641 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T17:32:20.689 DEBUG:teuthology.orchestra.run.smithi003:> true 2023-10-17T17:32:20.903 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi003.front.sepia.ceph.com' 2023-10-17T17:32:20.904 DEBUG:teuthology.orchestra.run.smithi003:> uname -m 2023-10-17T17:32:20.952 INFO:teuthology.orchestra.run.smithi003.stdout:x86_64 2023-10-17T17:32:20.953 DEBUG:teuthology.orchestra.run.smithi003:> cat /etc/os-release 2023-10-17T17:32:20.959 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="Ubuntu" 2023-10-17T17:32:20.959 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-17T17:32:20.959 INFO:teuthology.orchestra.run.smithi003.stdout:ID=ubuntu 2023-10-17T17:32:20.959 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE=debian 2023-10-17T17:32:20.960 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-17T17:32:20.960 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="20.04" 2023-10-17T17:32:20.960 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-17T17:32:20.960 INFO:teuthology.orchestra.run.smithi003.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-17T17:32:20.961 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-17T17:32:20.961 INFO:teuthology.orchestra.run.smithi003.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-17T17:32:20.961 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_CODENAME=focal 2023-10-17T17:32:20.961 INFO:teuthology.orchestra.run.smithi003.stdout:UBUNTU_CODENAME=focal 2023-10-17T17:32:20.962 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server 2023-10-17T17:32:20.980 INFO:teuthology.lock.ops:Updating [smithi131.front.sepia.ceph.com]: set os type and version on server 2023-10-17T17:32:20.981 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2023-10-17T17:32:20.981 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T17:32:21.029 DEBUG:teuthology.orchestra.run.smithi131:> true 2023-10-17T17:32:21.232 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi131.front.sepia.ceph.com' 2023-10-17T17:32:21.232 DEBUG:teuthology.orchestra.run.smithi131:> uname -m 2023-10-17T17:32:21.238 INFO:teuthology.orchestra.run.smithi131.stdout:x86_64 2023-10-17T17:32:21.238 DEBUG:teuthology.orchestra.run.smithi131:> cat /etc/os-release 2023-10-17T17:32:21.244 INFO:teuthology.orchestra.run.smithi131.stdout:NAME="Ubuntu" 2023-10-17T17:32:21.244 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-17T17:32:21.245 INFO:teuthology.orchestra.run.smithi131.stdout:ID=ubuntu 2023-10-17T17:32:21.245 INFO:teuthology.orchestra.run.smithi131.stdout:ID_LIKE=debian 2023-10-17T17:32:21.245 INFO:teuthology.orchestra.run.smithi131.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-17T17:32:21.245 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_ID="20.04" 2023-10-17T17:32:21.245 INFO:teuthology.orchestra.run.smithi131.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-17T17:32:21.246 INFO:teuthology.orchestra.run.smithi131.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-17T17:32:21.246 INFO:teuthology.orchestra.run.smithi131.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-17T17:32:21.246 INFO:teuthology.orchestra.run.smithi131.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-17T17:32:21.246 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_CODENAME=focal 2023-10-17T17:32:21.246 INFO:teuthology.orchestra.run.smithi131.stdout:UBUNTU_CODENAME=focal 2023-10-17T17:32:21.247 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server 2023-10-17T17:32:21.272 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: set os type and version on server 2023-10-17T17:32:21.272 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-10-17T17:32:21.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-17T17:32:21.323 DEBUG:teuthology.orchestra.run.smithi167:> true 2023-10-17T17:32:21.444 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-10-17T17:32:21.444 DEBUG:teuthology.orchestra.run.smithi167:> uname -m 2023-10-17T17:32:21.495 INFO:teuthology.orchestra.run.smithi167.stdout:x86_64 2023-10-17T17:32:21.495 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release 2023-10-17T17:32:21.502 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="Ubuntu" 2023-10-17T17:32:21.503 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-17T17:32:21.503 INFO:teuthology.orchestra.run.smithi167.stdout:ID=ubuntu 2023-10-17T17:32:21.503 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE=debian 2023-10-17T17:32:21.504 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-17T17:32:21.504 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="20.04" 2023-10-17T17:32:21.504 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-17T17:32:21.504 INFO:teuthology.orchestra.run.smithi167.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-17T17:32:21.504 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-17T17:32:21.505 INFO:teuthology.orchestra.run.smithi167.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-17T17:32:21.505 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_CODENAME=focal 2023-10-17T17:32:21.505 INFO:teuthology.orchestra.run.smithi167.stdout:UBUNTU_CODENAME=focal 2023-10-17T17:32:21.505 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2023-10-17T17:32:21.530 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T17:32:21.609 INFO:teuthology.dispatcher.supervisor:Running job 7430006 2023-10-17T17:32:21.610 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-10-16_15:27:04-rbd-wip-yuri11-testing-2023-10-10-1226-reef-distro-default-smithi/7430006 --name yuriw-2023-10-16_15:27:04-rbd-wip-yuri11-testing-2023-10-10-1226-reef-distro-default-smithi --description rbd/nbd/{base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_20.04} thrashers/cache thrashosds-health workloads/rbd_nbd_diff_continuous} -- /home/teuthworker/archive/yuriw-2023-10-16_15:27:04-rbd-wip-yuri11-testing-2023-10-10-1226-reef-distro-default-smithi/7430006/orig.config.yaml 2023-10-17T17:32:21.613 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-10-16_15:27:04-rbd-wip-yuri11-testing-2023-10-10-1226-reef-distro-default-smithi/7430006 2023-10-17T17:32:21.614 INFO:teuthology.dispatcher.supervisor:Job PID: 3698910 2023-10-17T17:32:21.614 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-17T17:34:21.616 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T17:36:21.684 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T17:38:21.739 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T17:40:21.804 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T17:42:21.878 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T17:44:21.940 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T17:46:22.014 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T17:48:22.088 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T17:50:22.160 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T17:52:22.236 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T17:54:22.297 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T17:56:22.389 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T17:58:22.450 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T18:00:22.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T18:02:22.597 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T18:04:22.661 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T18:06:22.733 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T18:08:22.801 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T18:10:22.872 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T18:12:22.948 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T18:14:23.018 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T18:16:23.091 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T18:18:23.156 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T18:20:23.253 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T18:22:23.329 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T18:24:23.392 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T18:26:23.467 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T18:28:23.544 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T18:30:23.616 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T18:32:23.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T18:34:23.757 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T18:36:23.821 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T18:38:23.887 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T18:40:23.952 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T18:42:24.025 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T18:44:24.099 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T18:46:24.172 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T18:48:24.238 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T18:50:24.301 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T18:52:24.377 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T18:54:24.449 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T18:56:24.530 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T18:58:24.598 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T19:00:24.664 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T19:02:24.747 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T19:04:24.812 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T19:06:24.877 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T19:08:24.944 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T19:10:25.019 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T19:12:25.094 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T19:14:25.172 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T19:16:25.247 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T19:18:25.312 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T19:20:25.385 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T19:22:25.452 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T19:24:25.507 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T19:26:25.573 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T19:28:25.650 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T19:30:25.713 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T19:32:25.780 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T19:34:25.843 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T19:36:25.958 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T19:38:26.021 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T19:40:26.092 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T19:42:26.158 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T19:44:26.230 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T19:46:26.305 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T19:48:26.369 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T19:50:26.688 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T19:52:26.760 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T19:54:26.820 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T19:56:26.889 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T19:58:26.954 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T20:00:27.018 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T20:02:27.082 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T20:04:27.138 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T20:06:27.202 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T20:08:27.270 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T20:10:27.341 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T20:12:27.407 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T20:14:27.471 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T20:16:27.544 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T20:18:27.609 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T20:20:27.682 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T20:22:27.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T20:24:27.821 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T20:26:27.970 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T20:28:28.041 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T20:30:28.105 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T20:32:28.181 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T20:34:28.246 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T20:36:28.310 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T20:38:28.378 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T20:40:28.449 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T20:42:28.521 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T20:44:28.594 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T20:46:28.711 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T20:48:28.792 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T20:50:28.866 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T20:52:28.928 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T20:54:29.001 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T20:56:29.066 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-17T20:56:29.124 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-17T20:56:29.291 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-17T20:56:29.291 INFO:teuthology.nuke:Checking targets against current locks 2023-10-17T20:56:29.342 DEBUG:teuthology.nuke:shortname: smithi003 2023-10-17T20:56:29.342 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-17T20:56:29.369 DEBUG:teuthology.nuke:shortname: smithi131 2023-10-17T20:56:29.369 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-17T20:56:29.372 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi003.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-16_15:27:04-rbd-wip-yuri11-testing-2023-10-10-1226-reef-distro-default-smithi/7430006', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-17 17:25:48.776185', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-17T20:56:29.393 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi131.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-16_15:27:04-rbd-wip-yuri11-testing-2023-10-10-1226-reef-distro-default-smithi/7430006', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-17 17:25:48.779082', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-17T20:56:29.398 DEBUG:teuthology.nuke:shortname: smithi167 2023-10-17T20:56:29.398 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-17T20:56:29.418 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi167.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-16_15:27:04-rbd-wip-yuri11-testing-2023-10-10-1226-reef-distro-default-smithi/7430006', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-17 17:25:48.777937', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-17T20:56:29.425 INFO:teuthology.orchestra.console.smithi003:Power off 2023-10-17T20:56:29.426 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-17T20:56:29.443 INFO:teuthology.orchestra.console.smithi131:Power off 2023-10-17T20:56:29.443 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-17T20:56:29.456 DEBUG:teuthology.orchestra.console.smithi003:power off output: Chassis Power Control: Down/Off 2023-10-17T20:56:29.457 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-17T20:56:29.464 DEBUG:teuthology.orchestra.console.smithi131:power off output: Chassis Power Control: Down/Off 2023-10-17T20:56:29.465 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-17T20:56:29.478 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is off 2023-10-17T20:56:29.484 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is off 2023-10-17T20:56:29.489 INFO:teuthology.orchestra.console.smithi167:Power off 2023-10-17T20:56:29.490 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-17T20:56:29.510 DEBUG:teuthology.orchestra.console.smithi167:power off output: Chassis Power Control: Down/Off 2023-10-17T20:56:29.511 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-17T20:56:29.530 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off 2023-10-17T20:56:29.579 INFO:teuthology.orchestra.console.smithi003:Power off completed 2023-10-17T20:56:29.584 INFO:teuthology.orchestra.console.smithi131:Power off completed 2023-10-17T20:56:29.632 INFO:teuthology.orchestra.console.smithi167:Power off completed 2023-10-17T20:56:29.732 INFO:teuthology.lock.ops:unlocked: smithi131.front.sepia.ceph.com 2023-10-17T20:56:29.741 INFO:teuthology.lock.ops:unlocked: smithi003.front.sepia.ceph.com 2023-10-17T20:56:29.784 INFO:teuthology.lock.ops:unlocked: smithi167.front.sepia.ceph.com