2023-10-11T22:11:02.638 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-11T22:11:02.640 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-11T22:11:02.784 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8048f1be50>, signals=[15]) 2023-10-11T22:11:02.786 INFO:teuthology.lock.ops:Start node 'smithi139.front.sepia.ceph.com' reimaging 2023-10-11T22:11:02.787 INFO:teuthology.lock.ops:Updating [smithi139.front.sepia.ceph.com]: reset os type and version on server 2023-10-11T22:11:02.787 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server 2023-10-11T22:11:02.807 INFO:teuthology.lock.ops:Start node 'smithi163.front.sepia.ceph.com' reimaging 2023-10-11T22:11:02.808 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: reset os type and version on server 2023-10-11T22:11:02.808 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2023-10-11T22:11:02.810 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /host {"name": "smithi139"} 2023-10-11T22:11:02.832 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /host {"name": "smithi163"} 2023-10-11T22:11:02.884 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-10-11T22:11:02.901 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-10-11T22:11:02.934 DEBUG:teuthology.provision.fog.smithi139:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-10-11T22:11:02.935 DEBUG:teuthology.provision.fog.smithi139:FOG request: PUT /host/244 {"imageID": 2} 2023-10-11T22:11:02.948 DEBUG:teuthology.provision.fog.smithi163:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-10-11T22:11:02.948 DEBUG:teuthology.provision.fog.smithi163:FOG request: PUT /host/268 {"imageID": 2} 2023-10-11T22:11:02.995 INFO:teuthology.provision.fog.smithi139:Scheduling deploy of ubuntu 20.04 2023-10-11T22:11:02.995 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-11T22:11:03.001 INFO:teuthology.provision.fog.smithi163:Scheduling deploy of ubuntu 20.04 2023-10-11T22:11:03.001 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-11T22:11:03.051 DEBUG:teuthology.provision.fog.smithi139:Canceling deploy task with ID 538935 2023-10-11T22:11:03.051 DEBUG:teuthology.provision.fog.smithi139:FOG request: DELETE /task/cancel {"id": 538935} 2023-10-11T22:11:03.055 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /tasktype {"name": "deploy"} 2023-10-11T22:11:03.087 DEBUG:teuthology.provision.fog.smithi163:FOG request: POST /host/268/task {"taskTypeID": 1} 2023-10-11T22:11:03.169 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-11T22:11:03.292 INFO:teuthology.orchestra.console.smithi163:Power off 2023-10-11T22:11:03.293 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-11T22:11:03.317 DEBUG:teuthology.orchestra.console.smithi163:power off output: Chassis Power Control: Down/Off 2023-10-11T22:11:03.318 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-11T22:11:03.327 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /tasktype {"name": "deploy"} 2023-10-11T22:11:03.338 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off 2023-10-11T22:11:03.372 DEBUG:teuthology.provision.fog.smithi139:FOG request: POST /host/244/task {"taskTypeID": 1} 2023-10-11T22:11:03.429 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-11T22:11:03.439 INFO:teuthology.orchestra.console.smithi163:Power off completed 2023-10-11T22:11:03.526 INFO:teuthology.orchestra.console.smithi139:Power off 2023-10-11T22:11:03.526 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-11T22:11:03.541 INFO:teuthology.orchestra.console.smithi163:Power on 2023-10-11T22:11:03.541 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-11T22:11:03.551 DEBUG:teuthology.orchestra.console.smithi139:power off output: Chassis Power Control: Down/Off 2023-10-11T22:11:03.552 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-11T22:11:03.565 DEBUG:teuthology.orchestra.console.smithi163:power on output: Chassis Power Control: Up/On 2023-10-11T22:11:03.566 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-11T22:11:03.578 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is off 2023-10-11T22:11:03.590 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off 2023-10-11T22:11:03.679 INFO:teuthology.orchestra.console.smithi139:Power off completed 2023-10-11T22:11:03.780 INFO:teuthology.orchestra.console.smithi139:Power on 2023-10-11T22:11:03.780 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-11T22:11:03.800 DEBUG:teuthology.orchestra.console.smithi139:power on output: Chassis Power Control: Up/On 2023-10-11T22:11:03.800 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-11T22:11:03.823 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is off 2023-10-11T22:11:07.594 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-11T22:11:07.703 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off 2023-10-11T22:11:07.825 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-11T22:11:07.934 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is off 2023-10-11T22:11:11.708 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-11T22:11:11.817 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on 2023-10-11T22:11:11.918 INFO:teuthology.orchestra.console.smithi163:Power on completed 2023-10-11T22:11:11.935 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-11T22:11:12.019 INFO:teuthology.provision.fog.smithi163:Waiting for deploy to finish 2023-10-11T22:11:12.020 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-11T22:11:12.155 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is on 2023-10-11T22:11:12.256 INFO:teuthology.orchestra.console.smithi139:Power on completed 2023-10-11T22:11:12.356 INFO:teuthology.provision.fog.smithi139:Waiting for deploy to finish 2023-10-11T22:11:12.357 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-11T22:11:27.110 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-11T22:11:27.441 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-11T22:11:42.198 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-11T22:11:42.529 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-11T22:11:57.302 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-11T22:11:57.611 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-11T22:12:12.390 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-11T22:12:12.693 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-11T22:12:27.502 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-11T22:12:27.774 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-11T22:12:42.610 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-11T22:12:42.862 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-11T22:12:57.706 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-11T22:12:57.944 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-11T22:13:12.810 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-11T22:13:13.046 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-11T22:13:27.926 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-11T22:13:28.171 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-11T22:13:43.035 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-11T22:13:43.287 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-11T22:13:58.154 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-11T22:13:58.400 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-11T22:14:13.234 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-11T22:14:13.493 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-11T22:14:28.314 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-11T22:14:28.578 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-11T22:14:43.396 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-11T22:14:43.647 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-10-11T22:14:43.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-11T22:14:58.490 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-11T22:15:13.563 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-11T22:15:15.930 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-10-11T22:15:21.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-11T22:15:24.986 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-10-11T22:15:28.622 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-11T22:15:28.677 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-11T22:15:30.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-11T22:15:34.074 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-10-11T22:15:36.318 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-10-11T22:15:40.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-11T22:15:42.322 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-11T22:15:45.402 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-10-11T22:15:51.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-11T22:15:54.458 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-10-11T22:16:00.463 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-11T22:16:02.526 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-10-11T22:16:08.531 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-11T22:16:08.666 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-10-11T22:16:14.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-11T22:16:14.814 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-10-11T22:16:20.819 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-11T22:16:20.954 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-10-11T22:16:26.958 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-11T22:16:27.098 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-10-11T22:16:33.102 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-11T22:16:33.246 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-10-11T22:16:39.251 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-11T22:16:39.386 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-10-11T22:16:40.082 WARNING:teuthology.provision.fog.smithi139:timed out 2023-10-11T22:16:45.392 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-11T22:16:45.534 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-10-11T22:16:46.085 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-11T22:16:49.146 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-10-11T22:16:51.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-11T22:16:51.674 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-10-11T22:16:55.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-11T22:16:57.679 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-11T22:16:57.822 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-10-11T22:16:58.206 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-10-11T22:17:03.826 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-11T22:17:03.962 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-10-11T22:17:04.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-11T22:17:07.258 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-10-11T22:17:09.966 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-11T22:17:10.110 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-10-11T22:17:13.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-11T22:17:16.114 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-11T22:17:16.250 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-10-11T22:17:22.255 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-11T22:17:22.398 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-10-11T22:17:28.402 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-11T22:17:28.542 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-10-11T22:17:31.770 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-10-11T22:17:34.546 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-11T22:17:34.682 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-10-11T22:17:37.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-11T22:17:40.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-11T22:17:40.826 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-10-11T22:17:40.827 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-10-11T22:17:46.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-11T22:17:46.832 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-11T22:17:46.951 ERROR:teuthology.orchestra.connection:Error authenticating with smithi139.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-10-11T22:17:51.072 ERROR:teuthology.orchestra.connection:Error authenticating with smithi139.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-10-11T22:17:57.118 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-10-11T22:17:58.152 ERROR:teuthology.orchestra.connection:Error authenticating with smithi139.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-10-11T22:18:03.120 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-11T22:18:06.206 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-10-11T22:18:08.233 ERROR:teuthology.orchestra.connection:Error authenticating with smithi139.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-10-11T22:18:12.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-11T22:18:12.338 ERROR:teuthology.orchestra.connection:Error authenticating with smithi163.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-10-11T22:18:16.467 ERROR:teuthology.orchestra.connection:Error authenticating with smithi163.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-10-11T22:18:21.351 ERROR:teuthology.orchestra.connection:Error authenticating with smithi139.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-10-11T22:18:23.558 ERROR:teuthology.orchestra.connection:Error authenticating with smithi163.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-10-11T22:18:33.650 ERROR:teuthology.orchestra.connection:Error authenticating with smithi163.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-10-11T22:18:37.470 ERROR:teuthology.orchestra.connection:Error authenticating with smithi139.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-10-11T22:18:46.781 ERROR:teuthology.orchestra.connection:Error authenticating with smithi163.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-10-11T22:19:03.081 ERROR:teuthology.orchestra.connection:Error authenticating with smithi163.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-10-11T22:19:56.472 WARNING:teuthology.provision.fog.smithi139:timed out 2023-10-11T22:19:56.666 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-10-11T22:20:02.475 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-11T22:20:02.668 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-11T22:20:05.530 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-10-11T22:20:05.726 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-10-11T22:20:11.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-11T22:20:11.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-11T22:20:14.586 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-10-11T22:20:14.782 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-10-11T22:20:20.588 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-11T22:20:20.783 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-11T22:20:20.853 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-11T22:20:20.854 DEBUG:teuthology.orchestra.run.smithi139:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-11T22:20:20.986 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-10-11T22:20:26.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-11T22:20:41.572 INFO:teuthology.provision.fog.smithi139:Node is ready 2023-10-11T22:20:41.573 DEBUG:teuthology.orchestra.run.smithi139:> hostname 2023-10-11T22:20:41.596 INFO:teuthology.orchestra.run.smithi139.stdout:smithi139.front.sepia.ceph.com 2023-10-11T22:20:41.597 DEBUG:teuthology.orchestra.run.smithi139:> grep smithi139.front.sepia.ceph.com /etc/hosts 2023-10-11T22:20:41.657 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139 smithi139.front.sepia.ceph.com smithi139 2023-10-11T22:20:41.658 DEBUG:teuthology.orchestra.run.smithi139:> sudo hostname smithi139 2023-10-11T22:20:41.800 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/smithi139.front.sepia.ceph.com/smithi139/g' /etc/hosts 2023-10-11T22:20:41.838 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/172.21.15.139/172.21.15.139/g' /etc/hosts 2023-10-11T22:20:41.907 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/smithi139.front.sepia.ceph.com/smithi139/g' /etc/hostname 2023-10-11T22:20:41.979 DEBUG:teuthology.orchestra.run.smithi139:> sudo hostname smithi139 2023-10-11T22:20:42.047 DEBUG:teuthology.orchestra.run.smithi139:> cat /etc/os-release 2023-10-11T22:20:42.105 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="CentOS Stream" 2023-10-11T22:20:42.105 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="8" 2023-10-11T22:20:42.106 INFO:teuthology.orchestra.run.smithi139.stdout:ID="centos" 2023-10-11T22:20:42.106 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE="rhel fedora" 2023-10-11T22:20:42.107 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="8" 2023-10-11T22:20:42.107 INFO:teuthology.orchestra.run.smithi139.stdout:PLATFORM_ID="platform:el8" 2023-10-11T22:20:42.107 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-11T22:20:42.108 INFO:teuthology.orchestra.run.smithi139.stdout:ANSI_COLOR="0;31" 2023-10-11T22:20:42.108 INFO:teuthology.orchestra.run.smithi139.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-11T22:20:42.108 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://centos.org/" 2023-10-11T22:20:42.109 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-11T22:20:42.109 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-11T22:20:42.110 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-11T22:20:42.113 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/provision/fog.py", line 348, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi139's OS to be ubuntu 20.04 but found centos 8 2023-10-11T22:20:42.114 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-11T22:20:42.257 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=42959d3150454bf685623c43b0fe3f71 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/provision/fog.py", line 348, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi139's OS to be ubuntu 20.04 but found centos 8 2023-10-11T22:20:42.260 INFO:teuthology.nuke:Checking targets against current locks 2023-10-11T22:20:42.295 INFO:teuthology.nuke:Not nuking smithi139.front.sepia.ceph.com because description doesn't match: teuthology-2023-10-11_22:00:49-upgrade:reef-x-main-distro-default-smithi != /home/teuthworker/archive/yuriw-2023-10-11_14:08:36-rados-wip-yuri11-testing-2023-10-10-1226-reef-distro-default-smithi/7421699 2023-10-11T22:20:42.319 INFO:teuthology.nuke:Not nuking smithi163.front.sepia.ceph.com because description doesn't match: teuthology-2023-10-11_22:00:49-upgrade:reef-x-main-distro-default-smithi != /home/teuthworker/archive/yuriw-2023-10-11_14:08:36-rados-wip-yuri11-testing-2023-10-10-1226-reef-distro-default-smithi/7421700 2023-10-11T22:20:42.320 ERROR:teuthology.nuke:Could not nuke the following targets: targets: smithi139.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGsRkVatXZR//kOAfNOv13YOKAM2QaL8OrfQZyDuUJHQinJkUv1swiIM2XU8Oi2gVFe8XRVPdSxu6B+8m+UKgiA= smithi163.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNNxqgdJjWhQLYPJuivA2+gzs1b5SDRPRA654FxsXWNTtXfz/IQ64UPmq9UL90w4mkwIFTS+shK4MA3/t2LBhQE= 2023-10-11T22:20:42.540 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/dispatcher/supervisor.py", line 58, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/provision/fog.py", line 348, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi139's OS to be ubuntu 20.04 but found centos 8