2023-07-29T20:08:34.708 INFO:root:teuthology version: 0.0.1.dev172+g6114016 2023-07-29T20:08:34.709 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T20:08:34.893 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fed0766bf70>, signals=[15]) 2023-07-29T20:08:34.894 INFO:teuthology.lock.ops:Start node 'smithi012.front.sepia.ceph.com' reimaging 2023-07-29T20:08:34.895 INFO:teuthology.lock.ops:Updating [smithi012.front.sepia.ceph.com]: reset os type and version on server 2023-07-29T20:08:34.895 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server 2023-07-29T20:08:34.932 INFO:teuthology.lock.ops:Start node 'smithi143.front.sepia.ceph.com' reimaging 2023-07-29T20:08:34.934 INFO:teuthology.lock.ops:Updating [smithi143.front.sepia.ceph.com]: reset os type and version on server 2023-07-29T20:08:34.934 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server 2023-07-29T20:08:34.936 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /host {"name": "smithi012"} 2023-07-29T20:08:34.956 INFO:teuthology.lock.ops:Start node 'smithi172.front.sepia.ceph.com' reimaging 2023-07-29T20:08:34.957 INFO:teuthology.lock.ops:Updating [smithi172.front.sepia.ceph.com]: reset os type and version on server 2023-07-29T20:08:34.957 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2023-07-29T20:08:34.958 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /host {"name": "smithi143"} 2023-07-29T20:08:34.981 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /host {"name": "smithi172"} 2023-07-29T20:08:35.018 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-07-29T20:08:35.029 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-07-29T20:08:35.049 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-07-29T20:08:35.061 DEBUG:teuthology.provision.fog.smithi012:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-07-29T20:08:35.062 DEBUG:teuthology.provision.fog.smithi012:FOG request: PUT /host/118 {"imageID": 2} 2023-07-29T20:08:35.065 DEBUG:teuthology.provision.fog.smithi143:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-07-29T20:08:35.065 DEBUG:teuthology.provision.fog.smithi143:FOG request: PUT /host/248 {"imageID": 2} 2023-07-29T20:08:35.099 INFO:teuthology.provision.fog.smithi012:Scheduling deploy of ubuntu 20.04 2023-07-29T20:08:35.099 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-29T20:08:35.103 DEBUG:teuthology.provision.fog.smithi172:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-07-29T20:08:35.104 DEBUG:teuthology.provision.fog.smithi172:FOG request: PUT /host/277 {"imageID": 2} 2023-07-29T20:08:35.107 INFO:teuthology.provision.fog.smithi143:Scheduling deploy of ubuntu 20.04 2023-07-29T20:08:35.107 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-29T20:08:35.147 INFO:teuthology.provision.fog.smithi172:Scheduling deploy of ubuntu 20.04 2023-07-29T20:08:35.148 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-07-29T20:08:35.199 DEBUG:teuthology.provision.fog.smithi143:Canceling deploy task with ID 420669 2023-07-29T20:08:35.200 DEBUG:teuthology.provision.fog.smithi143:FOG request: DELETE /task/cancel {"id": 420669} 2023-07-29T20:08:35.212 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /tasktype {"name": "deploy"} 2023-07-29T20:08:35.254 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /tasktype {"name": "deploy"} 2023-07-29T20:08:35.259 DEBUG:teuthology.provision.fog.smithi012:FOG request: POST /host/118/task {"taskTypeID": 1} 2023-07-29T20:08:35.269 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /tasktype {"name": "deploy"} 2023-07-29T20:08:35.292 DEBUG:teuthology.provision.fog.smithi143:FOG request: POST /host/248/task {"taskTypeID": 1} 2023-07-29T20:08:35.306 DEBUG:teuthology.provision.fog.smithi172:FOG request: POST /host/277/task {"taskTypeID": 1} 2023-07-29T20:08:35.310 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-29T20:08:35.344 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-29T20:08:35.350 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-07-29T20:08:35.444 INFO:teuthology.orchestra.console.smithi012:Power off 2023-07-29T20:08:35.445 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-29T20:08:35.467 DEBUG:teuthology.orchestra.console.smithi012:power off output: Chassis Power Control: Down/Off 2023-07-29T20:08:35.468 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T20:08:35.490 INFO:teuthology.orchestra.console.smithi172:Power off 2023-07-29T20:08:35.491 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-29T20:08:35.509 INFO:teuthology.orchestra.console.smithi143:Power off 2023-07-29T20:08:35.509 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-29T20:08:35.518 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is off 2023-07-29T20:08:35.520 DEBUG:teuthology.orchestra.console.smithi172:power off output: Chassis Power Control: Down/Off 2023-07-29T20:08:35.521 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T20:08:35.530 DEBUG:teuthology.orchestra.console.smithi143:power off output: Chassis Power Control: Down/Off 2023-07-29T20:08:35.531 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T20:08:35.541 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off 2023-07-29T20:08:35.551 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off 2023-07-29T20:08:35.620 INFO:teuthology.orchestra.console.smithi012:Power off completed 2023-07-29T20:08:35.642 INFO:teuthology.orchestra.console.smithi172:Power off completed 2023-07-29T20:08:35.652 INFO:teuthology.orchestra.console.smithi143:Power off completed 2023-07-29T20:08:35.721 INFO:teuthology.orchestra.console.smithi012:Power on 2023-07-29T20:08:35.721 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-29T20:08:35.744 DEBUG:teuthology.orchestra.console.smithi012:power on output: Chassis Power Control: Up/On 2023-07-29T20:08:35.744 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T20:08:35.752 INFO:teuthology.orchestra.console.smithi172:Power on 2023-07-29T20:08:35.753 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-29T20:08:35.761 INFO:teuthology.orchestra.console.smithi143:Power on 2023-07-29T20:08:35.762 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-29T20:08:35.771 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is off 2023-07-29T20:08:35.773 DEBUG:teuthology.orchestra.console.smithi172:power on output: Chassis Power Control: Up/On 2023-07-29T20:08:35.773 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T20:08:35.783 DEBUG:teuthology.orchestra.console.smithi143:power on output: Chassis Power Control: Up/On 2023-07-29T20:08:35.784 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T20:08:35.795 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off 2023-07-29T20:08:35.803 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off 2023-07-29T20:08:39.775 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T20:08:39.796 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T20:08:39.805 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T20:08:39.886 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on 2023-07-29T20:08:39.906 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off 2023-07-29T20:08:39.915 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is on 2023-07-29T20:08:39.988 INFO:teuthology.orchestra.console.smithi012:Power on completed 2023-07-29T20:08:40.017 INFO:teuthology.orchestra.console.smithi143:Power on completed 2023-07-29T20:08:40.089 INFO:teuthology.provision.fog.smithi012:Waiting for deploy to finish 2023-07-29T20:08:40.090 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-29T20:08:40.118 INFO:teuthology.provision.fog.smithi143:Waiting for deploy to finish 2023-07-29T20:08:40.118 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-29T20:08:43.908 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T20:08:44.093 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2023-07-29T20:08:44.194 INFO:teuthology.orchestra.console.smithi172:Power on completed 2023-07-29T20:08:44.295 INFO:teuthology.provision.fog.smithi172:Waiting for deploy to finish 2023-07-29T20:08:44.295 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-07-29T20:08:44.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T20:08:55.291 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-29T20:08:55.293 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-29T20:09:03.088 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-07-29T20:09:09.095 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T20:09:10.479 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-29T20:09:10.500 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-29T20:09:12.176 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-07-29T20:09:18.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T20:09:21.264 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-07-29T20:09:25.703 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-29T20:09:25.706 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-29T20:09:27.267 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T20:09:30.320 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-07-29T20:09:36.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T20:09:39.376 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-07-29T20:09:40.945 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-29T20:09:40.949 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-29T20:09:45.378 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T20:09:48.432 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-07-29T20:09:54.435 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T20:09:56.140 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-29T20:09:56.149 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-29T20:09:57.488 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-07-29T20:10:03.495 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T20:10:11.406 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-29T20:10:11.408 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-29T20:10:21.936 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-07-29T20:10:26.644 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-29T20:10:26.646 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-29T20:10:27.939 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T20:10:27.940 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-07-29T20:10:33.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T20:10:34.064 ERROR:teuthology.orchestra.connection:Error authenticating with smithi172.front.sepia.ceph.com: Authentication failed. 2023-07-29T20:10:34.065 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-29T20:10:34.066 DEBUG:teuthology.orchestra.run.smithi172:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-29T20:10:34.067 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:10:35.071 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:10:36.076 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:10:37.080 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:10:38.084 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:10:39.089 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:10:40.094 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:10:41.098 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:10:41.916 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-29T20:10:41.927 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-29T20:10:42.102 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:10:43.110 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:10:44.114 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:10:45.119 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:10:46.122 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:10:47.126 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:10:48.130 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:10:49.135 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:10:50.140 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:10:51.145 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:10:52.149 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:10:53.153 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:10:54.158 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:10:55.162 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:10:56.165 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:10:57.169 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:10:57.631 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-29T20:10:57.661 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-29T20:10:58.174 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:10:59.179 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:11:00.183 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:11:01.187 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:11:02.190 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:11:03.194 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:11:04.198 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:11:05.201 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:11:06.205 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:11:07.209 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:11:08.212 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:11:09.217 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:11:10.221 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:11:11.225 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:11:12.229 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:11:13.072 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-29T20:11:13.233 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:11:13.355 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-29T20:11:14.238 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:11:15.243 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:11:16.247 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:11:17.251 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:11:18.255 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:11:19.259 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:11:20.263 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:11:21.268 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:11:22.272 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:11:23.276 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:11:24.280 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:11:25.285 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:11:26.289 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:11:27.293 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:11:28.297 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:11:28.480 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-29T20:11:28.843 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-29T20:11:29.303 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:11:30.307 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:11:31.311 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:11:32.315 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:11:33.320 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:11:34.324 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:11:35.329 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:11:36.333 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:11:37.337 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:11:38.341 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:11:39.345 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:11:40.348 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:11:41.353 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:11:42.357 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:11:43.361 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:11:43.855 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-29T20:11:44.183 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-29T20:11:44.366 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:11:45.370 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:11:46.374 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:11:47.378 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:11:48.381 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:11:49.387 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:11:50.392 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:11:51.396 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:11:52.402 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:11:53.407 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:11:54.412 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:11:55.416 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:11:56.421 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:11:57.426 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:11:58.430 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:11:59.204 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-29T20:11:59.434 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:11:59.437 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-29T20:12:00.440 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:12:01.444 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:12:02.449 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:12:03.454 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:12:04.458 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:12:05.467 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:12:06.471 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:12:07.476 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:12:08.480 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:12:09.485 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:12:10.489 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:12:11.493 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:12:12.497 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:12:13.503 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:12:14.508 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:12:14.577 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-29T20:12:14.803 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-07-29T20:12:15.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T20:12:15.514 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:12:16.519 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:12:17.523 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:12:18.224 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-07-29T20:12:18.527 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:12:19.533 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:12:20.538 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:12:21.543 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:12:22.548 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:12:23.553 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:12:24.226 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T20:12:24.560 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:12:25.564 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:12:26.568 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:12:27.280 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-07-29T20:12:27.572 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:12:28.576 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:12:29.580 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:12:29.967 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-29T20:12:30.585 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:12:31.590 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:12:32.594 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:12:33.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T20:12:33.598 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:12:33.954 ERROR:teuthology.provision.fog: on smithi172 2023-07-29T20:12:36.336 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-07-29T20:12:42.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T20:12:42.956 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-07-29T20:12:42.957 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T20:12:43.032 ERROR:teuthology.orchestra.connection:Error authenticating with smithi172.front.sepia.ceph.com: Authentication failed. 2023-07-29T20:12:43.032 DEBUG:teuthology.orchestra.run.smithi172:> true 2023-07-29T20:12:43.033 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:12:45.314 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-29T20:12:45.392 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-07-29T20:12:51.394 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T20:13:00.693 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-29T20:13:16.058 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-29T20:13:31.466 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-29T20:13:46.805 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-29T20:13:51.395 WARNING:teuthology.provision.fog.smithi012:timed out 2023-07-29T20:13:57.397 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T20:13:57.612 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-29T20:13:57.612 DEBUG:teuthology.orchestra.run.smithi012:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-29T20:13:58.136 INFO:teuthology.provision.fog.smithi012:Node is ready 2023-07-29T20:13:58.137 DEBUG:teuthology.orchestra.run.smithi012:> hostname 2023-07-29T20:13:58.142 INFO:teuthology.orchestra.run.smithi012.stdout:smithi012.front.sepia.ceph.com 2023-07-29T20:13:58.142 DEBUG:teuthology.orchestra.run.smithi012:> grep smithi012.front.sepia.ceph.com /etc/hosts 2023-07-29T20:13:58.149 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12 smithi012.front.sepia.ceph.com smithi012 2023-07-29T20:13:58.150 DEBUG:teuthology.orchestra.run.smithi012:> sudo hostname smithi012 2023-07-29T20:13:58.298 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i -e 's/smithi012.front.sepia.ceph.com/smithi012/g' /etc/hosts 2023-07-29T20:13:58.314 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i -e 's/172.21.15.12/172.21.15.12/g' /etc/hosts 2023-07-29T20:13:58.329 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i -e 's/smithi012.front.sepia.ceph.com/smithi012/g' /etc/hostname 2023-07-29T20:13:58.345 DEBUG:teuthology.orchestra.run.smithi012:> sudo hostname smithi012 2023-07-29T20:13:58.353 DEBUG:teuthology.orchestra.run.smithi012:> cat /etc/os-release 2023-07-29T20:13:58.357 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="Ubuntu" 2023-07-29T20:13:58.358 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-29T20:13:58.358 INFO:teuthology.orchestra.run.smithi012.stdout:ID=ubuntu 2023-07-29T20:13:58.358 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE=debian 2023-07-29T20:13:58.358 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-29T20:13:58.358 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="20.04" 2023-07-29T20:13:58.358 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-29T20:13:58.358 INFO:teuthology.orchestra.run.smithi012.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-29T20:13:58.359 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-29T20:13:58.359 INFO:teuthology.orchestra.run.smithi012.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-29T20:13:58.359 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_CODENAME=focal 2023-07-29T20:13:58.359 INFO:teuthology.orchestra.run.smithi012.stdout:UBUNTU_CODENAME=focal 2023-07-29T20:13:58.360 INFO:teuthology.provision.fog.smithi012:Deploy complete! 2023-07-29T20:13:58.361 DEBUG:teuthology.parallel:result is None 2023-07-29T20:14:02.160 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-29T20:14:17.464 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-29T20:14:32.787 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-29T20:14:48.108 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-29T20:14:51.968 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-07-29T20:14:51.969 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T20:14:52.083 ERROR:teuthology.orchestra.connection:Error authenticating with smithi172.front.sepia.ceph.com: Authentication failed. 2023-07-29T20:14:52.083 DEBUG:teuthology.orchestra.run.smithi172:> true 2023-07-29T20:14:52.084 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:15:03.431 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-29T20:15:18.758 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-29T20:15:34.032 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-29T20:15:49.336 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-29T20:16:04.643 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-29T20:16:19.908 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-29T20:16:35.221 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-29T20:16:50.560 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-29T20:17:03.987 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-07-29T20:17:03.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T20:17:04.064 ERROR:teuthology.orchestra.connection:Error authenticating with smithi172.front.sepia.ceph.com: Authentication failed. 2023-07-29T20:17:04.064 DEBUG:teuthology.orchestra.run.smithi172:> true 2023-07-29T20:17:04.065 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:17:05.847 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-29T20:17:21.115 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-29T20:17:36.383 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-29T20:17:51.630 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-29T20:18:06.888 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-29T20:18:22.133 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-29T20:18:37.408 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-29T20:18:52.647 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-29T20:19:06.996 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-07-29T20:19:06.997 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T20:19:07.073 ERROR:teuthology.orchestra.connection:Error authenticating with smithi172.front.sepia.ceph.com: Authentication failed. 2023-07-29T20:19:07.074 DEBUG:teuthology.orchestra.run.smithi172:> true 2023-07-29T20:19:07.075 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:19:07.881 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-29T20:19:23.078 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-29T20:19:38.279 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-29T20:19:53.485 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-29T20:20:08.690 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-29T20:20:23.875 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-29T20:20:39.070 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-29T20:20:54.255 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-29T20:21:07.002 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-07-29T20:21:07.003 ERROR:teuthology.provision.fog:Failed to reconnect to smithi172 on smithi172 2023-07-29T20:21:09.424 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-07-29T20:21:09.587 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T20:21:19.012 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-07-29T20:21:19.013 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T20:21:19.088 ERROR:teuthology.orchestra.connection:Error authenticating with smithi172.front.sepia.ceph.com: Authentication failed. 2023-07-29T20:21:19.088 DEBUG:teuthology.orchestra.run.smithi172:> true 2023-07-29T20:21:19.089 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:21:28.048 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-07-29T20:21:34.049 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T20:21:37.104 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-07-29T20:21:43.106 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T20:21:46.160 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-07-29T20:21:52.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T20:21:55.216 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-07-29T20:22:01.218 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T20:23:01.219 WARNING:teuthology.provision.fog.smithi143:timed out 2023-07-29T20:23:07.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T20:23:07.420 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-29T20:23:07.420 DEBUG:teuthology.orchestra.run.smithi143:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-29T20:23:07.917 INFO:teuthology.provision.fog.smithi143:Node is ready 2023-07-29T20:23:07.917 DEBUG:teuthology.orchestra.run.smithi143:> hostname 2023-07-29T20:23:07.923 INFO:teuthology.orchestra.run.smithi143.stdout:smithi143.front.sepia.ceph.com 2023-07-29T20:23:07.924 DEBUG:teuthology.orchestra.run.smithi143:> grep smithi143.front.sepia.ceph.com /etc/hosts 2023-07-29T20:23:07.930 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.15.143 smithi143.front.sepia.ceph.com smithi143 2023-07-29T20:23:07.931 DEBUG:teuthology.orchestra.run.smithi143:> sudo hostname smithi143 2023-07-29T20:23:08.029 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i -e 's/smithi143.front.sepia.ceph.com/smithi143/g' /etc/hosts 2023-07-29T20:23:08.045 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i -e 's/172.21.15.143/172.21.15.143/g' /etc/hosts 2023-07-29T20:23:08.102 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i -e 's/smithi143.front.sepia.ceph.com/smithi143/g' /etc/hostname 2023-07-29T20:23:08.113 DEBUG:teuthology.orchestra.run.smithi143:> sudo hostname smithi143 2023-07-29T20:23:08.123 DEBUG:teuthology.orchestra.run.smithi143:> cat /etc/os-release 2023-07-29T20:23:08.172 INFO:teuthology.orchestra.run.smithi143.stdout:NAME="Ubuntu" 2023-07-29T20:23:08.173 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-29T20:23:08.173 INFO:teuthology.orchestra.run.smithi143.stdout:ID=ubuntu 2023-07-29T20:23:08.173 INFO:teuthology.orchestra.run.smithi143.stdout:ID_LIKE=debian 2023-07-29T20:23:08.174 INFO:teuthology.orchestra.run.smithi143.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-29T20:23:08.174 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_ID="20.04" 2023-07-29T20:23:08.174 INFO:teuthology.orchestra.run.smithi143.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-29T20:23:08.175 INFO:teuthology.orchestra.run.smithi143.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-29T20:23:08.175 INFO:teuthology.orchestra.run.smithi143.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-29T20:23:08.175 INFO:teuthology.orchestra.run.smithi143.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-29T20:23:08.175 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_CODENAME=focal 2023-07-29T20:23:08.176 INFO:teuthology.orchestra.run.smithi143.stdout:UBUNTU_CODENAME=focal 2023-07-29T20:23:08.176 INFO:teuthology.provision.fog.smithi143:Deploy complete! 2023-07-29T20:23:08.177 DEBUG:teuthology.parallel:result is None 2023-07-29T20:23:28.018 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-07-29T20:23:28.019 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T20:23:28.097 ERROR:teuthology.orchestra.connection:Error authenticating with smithi172.front.sepia.ceph.com: Authentication failed. 2023-07-29T20:23:28.098 DEBUG:teuthology.orchestra.run.smithi172:> true 2023-07-29T20:23:28.099 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T20:25:40.036 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-07-29T20:25:40.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T20:25:40.113 ERROR:teuthology.orchestra.connection:Error authenticating with smithi172.front.sepia.ceph.com: Authentication failed. 2023-07-29T20:25:40.114 DEBUG:teuthology.orchestra.run.smithi172:> true 2023-07-29T20:25:40.115 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T21:25:43.193 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-07-29T21:25:43.195 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T21:25:56.272 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-07-29T21:25:56.273 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-07-29T21:25:56.273 ERROR:teuthology.provision.fog:Failed to reconnect to smithi172 on smithi172 2023-07-29T21:26:11.274 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-29T21:26:11.274 DEBUG:teuthology.orchestra.run.smithi172:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-29T21:28:55.668 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-07-29T21:28:55.670 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi172 2023-07-29T21:29:13.688 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-07-29T21:29:13.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T21:29:18.772 ERROR:teuthology.orchestra.connection:Error authenticating with smithi172.front.sepia.ceph.com: Authentication failed. 2023-07-29T21:29:18.773 DEBUG:teuthology.orchestra.run.smithi172:> true 2023-07-29T21:29:18.774 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-29T22:29:27.787 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-07-29T22:29:27.816 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T22:29:27.887 DEBUG:teuthology.orchestra.run.smithi172:> true 2023-07-29T22:29:27.965 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-07-29T22:29:27.966 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-29T22:29:27.966 DEBUG:teuthology.orchestra.run.smithi172:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-29T22:29:28.026 INFO:teuthology.provision.fog.smithi172:Node is ready 2023-07-29T22:29:28.026 DEBUG:teuthology.orchestra.run.smithi172:> hostname 2023-07-29T22:29:28.085 INFO:teuthology.orchestra.run.smithi172.stdout:smithi172 2023-07-29T22:29:28.085 DEBUG:teuthology.orchestra.run.smithi172:> grep smithi172 /etc/hosts 2023-07-29T22:29:28.144 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.15.172 smithi172.front.sepia.ceph.com smithi172 2023-07-29T22:29:28.144 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.15.172 smithi172 smithi172 2023-07-29T22:29:28.144 DEBUG:teuthology.orchestra.run.smithi172:> sudo hostname smithi172 2023-07-29T22:29:28.214 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/smithi172/smithi172/g' /etc/hosts 2023-07-29T22:29:28.282 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/172.21.15.172/172.21.15.172/g' /etc/hosts 2023-07-29T22:29:28.353 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/smithi172/smithi172/g' /etc/hostname 2023-07-29T22:29:28.422 DEBUG:teuthology.orchestra.run.smithi172:> sudo hostname smithi172 2023-07-29T22:29:28.490 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2023-07-29T22:29:28.548 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="CentOS Stream" 2023-07-29T22:29:28.548 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="8" 2023-07-29T22:29:28.548 INFO:teuthology.orchestra.run.smithi172.stdout:ID="centos" 2023-07-29T22:29:28.548 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="rhel fedora" 2023-07-29T22:29:28.548 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="8" 2023-07-29T22:29:28.549 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el8" 2023-07-29T22:29:28.549 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-29T22:29:28.549 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2023-07-29T22:29:28.549 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-29T22:29:28.549 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://centos.org/" 2023-07-29T22:29:28.549 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-29T22:29:28.549 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-29T22:29:28.550 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-29T22:29:28.551 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/provision/fog.py", line 348, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi172's OS to be ubuntu 20.04 but found centos 8 2023-07-29T22:29:28.552 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T22:29:28.699 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=85d91ed74a13488c8026d1ae97a02fd5 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/provision/fog.py", line 348, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi172's OS to be ubuntu 20.04 but found centos 8 2023-07-29T22:29:28.709 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/provision/fog.py", line 348, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi172's OS to be ubuntu 20.04 but found centos 8 During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/dispatcher/supervisor.py", line 58, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/dispatcher/supervisor.py", line 236, in reimage ctx.summary['sentry_event'] = sentry.report_error(job_config, e) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/config.py", line 263, in __getattr__ raise AttributeError(name) AttributeError: summary