2024-01-05T16:42:24.449 INFO:root:teuthology version: 0.0.1.dev228+g01dd171 2024-01-05T16:42:24.450 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-05T16:42:24.641 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f0fc1e51940>, signals=[15]) 2024-01-05T16:42:24.642 INFO:teuthology.lock.ops:Start node 'smithi069.front.sepia.ceph.com' reimaging 2024-01-05T16:42:24.642 INFO:teuthology.lock.ops:Updating [smithi069.front.sepia.ceph.com]: reset os type and version on server 2024-01-05T16:42:24.642 INFO:teuthology.lock.ops:Updating smithi069.front.sepia.ceph.com on lock server 2024-01-05T16:42:24.664 INFO:teuthology.lock.ops:Start node 'smithi146.front.sepia.ceph.com' reimaging 2024-01-05T16:42:24.664 INFO:teuthology.lock.ops:Updating [smithi146.front.sepia.ceph.com]: reset os type and version on server 2024-01-05T16:42:24.664 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server 2024-01-05T16:42:24.680 INFO:teuthology.lock.ops:Start node 'smithi163.front.sepia.ceph.com' reimaging 2024-01-05T16:42:24.681 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: reset os type and version on server 2024-01-05T16:42:24.681 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2024-01-05T16:42:24.817 DEBUG:teuthology.provision.fog.smithi146:Requesting image smithi_centos_8.stream (ID 3) 2024-01-05T16:42:24.820 DEBUG:teuthology.provision.fog.smithi069:Requesting image smithi_centos_8.stream (ID 3) 2024-01-05T16:42:24.853 DEBUG:teuthology.provision.fog.smithi163:Requesting image smithi_centos_8.stream (ID 3) 2024-01-05T16:42:24.871 INFO:teuthology.provision.fog.smithi069:Scheduling deploy of centos 8.stream 2024-01-05T16:42:24.874 INFO:teuthology.provision.fog.smithi146:Scheduling deploy of centos 8.stream 2024-01-05T16:42:24.896 INFO:teuthology.provision.fog.smithi163:Scheduling deploy of centos 8.stream 2024-01-05T16:42:24.982 DEBUG:teuthology.provision.fog.smithi163:Canceling deploy task with ID 699972 2024-01-05T16:42:25.133 INFO:teuthology.orchestra.console.smithi069:Power off 2024-01-05T16:42:25.134 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-05T16:42:25.155 DEBUG:teuthology.orchestra.console.smithi069:power off output: Chassis Power Control: Down/Off 2024-01-05T16:42:25.155 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-05T16:42:25.178 INFO:teuthology.orchestra.console.smithi146:Power off 2024-01-05T16:42:25.179 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-05T16:42:25.187 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off 2024-01-05T16:42:25.202 DEBUG:teuthology.orchestra.console.smithi146:power off output: Chassis Power Control: Down/Off 2024-01-05T16:42:25.202 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-05T16:42:25.220 INFO:teuthology.orchestra.console.smithi163:Power off 2024-01-05T16:42:25.220 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-05T16:42:25.229 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is off 2024-01-05T16:42:25.241 DEBUG:teuthology.orchestra.console.smithi163:power off output: Chassis Power Control: Down/Off 2024-01-05T16:42:25.241 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-05T16:42:25.264 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off 2024-01-05T16:42:25.288 INFO:teuthology.orchestra.console.smithi069:Power off completed 2024-01-05T16:42:25.330 INFO:teuthology.orchestra.console.smithi146:Power off completed 2024-01-05T16:42:25.365 INFO:teuthology.orchestra.console.smithi163:Power off completed 2024-01-05T16:42:25.389 INFO:teuthology.orchestra.console.smithi069:Power on 2024-01-05T16:42:25.390 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-05T16:42:25.411 DEBUG:teuthology.orchestra.console.smithi069:power on output: Chassis Power Control: Up/On 2024-01-05T16:42:25.411 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-05T16:42:25.431 INFO:teuthology.orchestra.console.smithi146:Power on 2024-01-05T16:42:25.431 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-05T16:42:25.438 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off 2024-01-05T16:42:25.452 DEBUG:teuthology.orchestra.console.smithi146:power on output: Chassis Power Control: Up/On 2024-01-05T16:42:25.452 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-05T16:42:25.466 INFO:teuthology.orchestra.console.smithi163:Power on 2024-01-05T16:42:25.466 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-05T16:42:25.474 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is off 2024-01-05T16:42:25.488 DEBUG:teuthology.orchestra.console.smithi163:power on output: Chassis Power Control: Up/On 2024-01-05T16:42:25.488 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-05T16:42:25.508 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off 2024-01-05T16:42:29.439 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-05T16:42:29.475 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-05T16:42:29.510 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-05T16:42:29.548 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off 2024-01-05T16:42:29.583 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is off 2024-01-05T16:42:29.617 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on 2024-01-05T16:42:29.718 INFO:teuthology.orchestra.console.smithi163:Power on completed 2024-01-05T16:42:29.818 INFO:teuthology.provision.fog.smithi163:Waiting for deploy to finish 2024-01-05T16:42:33.550 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-05T16:42:33.584 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-05T16:42:33.659 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on 2024-01-05T16:42:33.723 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is on 2024-01-05T16:42:33.760 INFO:teuthology.orchestra.console.smithi069:Power on completed 2024-01-05T16:42:33.824 INFO:teuthology.orchestra.console.smithi146:Power on completed 2024-01-05T16:42:33.861 INFO:teuthology.provision.fog.smithi069:Waiting for deploy to finish 2024-01-05T16:42:33.924 INFO:teuthology.provision.fog.smithi146:Waiting for deploy to finish 2024-01-05T16:45:00.772 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-05T16:45:01.916 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-01-05T16:45:04.786 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-05T16:45:04.791 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-05T16:45:04.828 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2024-01-05T16:45:07.868 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146 2024-01-05T16:45:07.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-05T16:45:10.832 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-05T16:45:10.972 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-01-05T16:45:13.872 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-05T16:45:13.884 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2024-01-05T16:45:16.924 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146 2024-01-05T16:45:16.973 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-05T16:45:19.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-05T16:45:20.028 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-01-05T16:45:22.929 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-05T16:45:22.940 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2024-01-05T16:45:25.980 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146 2024-01-05T16:45:26.029 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-05T16:45:28.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-05T16:45:29.088 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2024-01-05T16:45:29.088 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-01-05T16:45:31.984 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-05T16:45:35.036 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146 2024-01-05T16:45:35.089 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-05T16:45:35.091 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-05T16:45:38.140 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-01-05T16:45:38.140 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2024-01-05T16:45:41.040 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-05T16:45:44.092 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146 2024-01-05T16:45:44.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-05T16:45:44.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-05T16:45:47.196 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-01-05T16:45:47.196 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2024-01-05T16:45:50.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-05T16:45:53.148 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146 2024-01-05T16:45:53.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-05T16:45:53.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-05T16:45:53.340 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2024-01-05T16:45:56.252 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-01-05T16:45:59.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-05T16:45:59.341 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-05T16:46:02.205 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146 2024-01-05T16:46:02.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-05T16:46:02.396 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2024-01-05T16:46:05.308 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-01-05T16:46:08.209 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-05T16:46:08.397 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-05T16:46:11.264 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146 2024-01-05T16:46:11.310 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-05T16:46:11.456 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2024-01-05T16:46:14.364 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-01-05T16:46:17.268 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-05T16:46:17.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-05T16:46:20.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-05T16:46:23.420 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-01-05T16:46:27.644 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2024-01-05T16:46:29.423 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-05T16:46:32.476 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-01-05T16:46:33.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-05T16:46:35.836 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146 2024-01-05T16:46:36.700 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2024-01-05T16:46:38.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-05T16:46:41.849 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-05T16:46:42.703 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-05T16:46:43.206 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2024-01-05T16:46:44.572 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-01-05T16:46:44.928 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146 2024-01-05T16:46:49.207 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-05T16:46:49.334 ERROR:teuthology.orchestra.connection:Error authenticating with smithi069.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-01-05T16:46:50.573 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-05T16:46:50.929 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-05T16:46:51.018 ERROR:teuthology.orchestra.connection:Error authenticating with smithi146.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-01-05T16:46:53.465 ERROR:teuthology.orchestra.connection:Error authenticating with smithi069.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-01-05T16:46:53.628 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-01-05T16:46:55.149 ERROR:teuthology.orchestra.connection:Error authenticating with smithi146.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-01-05T16:46:59.629 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-05T16:47:00.590 ERROR:teuthology.orchestra.connection:Error authenticating with smithi069.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-01-05T16:47:02.177 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-01-05T16:47:02.237 ERROR:teuthology.orchestra.connection:Error authenticating with smithi146.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-01-05T16:47:08.178 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-05T16:47:08.257 ERROR:teuthology.orchestra.connection:Error authenticating with smithi163.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-01-05T16:47:10.717 ERROR:teuthology.orchestra.connection:Error authenticating with smithi069.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-01-05T16:47:12.328 ERROR:teuthology.orchestra.connection:Error authenticating with smithi146.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-01-05T16:47:12.377 ERROR:teuthology.orchestra.connection:Error authenticating with smithi163.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-01-05T16:47:19.495 ERROR:teuthology.orchestra.connection:Error authenticating with smithi163.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-01-05T16:47:23.842 ERROR:teuthology.orchestra.connection:Error authenticating with smithi069.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-01-05T16:47:25.457 ERROR:teuthology.orchestra.connection:Error authenticating with smithi146.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-01-05T16:47:29.613 ERROR:teuthology.orchestra.connection:Error authenticating with smithi163.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-01-05T16:47:39.968 ERROR:teuthology.orchestra.connection:Error authenticating with smithi069.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-01-05T16:47:41.545 ERROR:teuthology.orchestra.connection:Error authenticating with smithi146.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-01-05T16:47:42.692 ERROR:teuthology.orchestra.connection:Error authenticating with smithi163.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-01-05T16:47:58.695 ERROR:paramiko.transport:Exception (client): Error reading SSH protocol banner 2024-01-05T16:47:58.697 ERROR:paramiko.transport:Traceback (most recent call last): 2024-01-05T16:47:58.697 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2271, in _check_banner 2024-01-05T16:47:58.697 ERROR:paramiko.transport: buf = self.packetizer.readline(timeout) 2024-01-05T16:47:58.698 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 380, in readline 2024-01-05T16:47:58.698 ERROR:paramiko.transport: buf += self._read_timeout(timeout) 2024-01-05T16:47:58.698 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 609, in _read_timeout 2024-01-05T16:47:58.698 ERROR:paramiko.transport: raise EOFError() 2024-01-05T16:47:58.698 ERROR:paramiko.transport:EOFError 2024-01-05T16:47:58.698 ERROR:paramiko.transport: 2024-01-05T16:47:58.698 ERROR:paramiko.transport:During handling of the above exception, another exception occurred: 2024-01-05T16:47:58.698 ERROR:paramiko.transport: 2024-01-05T16:47:58.698 ERROR:paramiko.transport:Traceback (most recent call last): 2024-01-05T16:47:58.698 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2094, in run 2024-01-05T16:47:58.698 ERROR:paramiko.transport: self._check_banner() 2024-01-05T16:47:58.698 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2275, in _check_banner 2024-01-05T16:47:58.698 ERROR:paramiko.transport: raise SSHException( 2024-01-05T16:47:58.698 ERROR:paramiko.transport:paramiko.ssh_exception.SSHException: Error reading SSH protocol banner 2024-01-05T16:47:58.699 ERROR:paramiko.transport: 2024-01-05T16:47:58.699 ERROR:teuthology.orchestra.connection:Error authenticating with smithi163.front.sepia.ceph.com: SSHException('Error reading SSH protocol banner') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2271, in _check_banner buf = self.packetizer.readline(timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 380, in readline buf += self._read_timeout(timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 609, in _read_timeout raise EOFError() EOFError During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 421, in connect t.start_client(timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 699, in start_client raise e File "/home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2094, in run self._check_banner() File "/home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2275, in _check_banner raise SSHException( paramiko.ssh_exception.SSHException: Error reading SSH protocol banner 2024-01-05T16:48:17.212 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2024-01-05T16:48:17.780 ERROR:teuthology.orchestra.connection:Error authenticating with smithi163.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-01-05T16:48:19.004 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146 2024-01-05T16:48:23.215 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-05T16:48:25.005 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-05T16:48:25.660 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2024-01-05T16:48:25.660 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146 2024-01-05T16:48:31.661 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-05T16:48:31.663 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-05T16:48:34.716 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2024-01-05T16:48:34.716 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146 2024-01-05T16:48:40.717 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-05T16:48:40.718 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-05T16:48:43.772 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2024-01-05T16:48:43.772 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146 2024-01-05T16:48:49.773 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-05T16:48:49.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-05T16:48:49.984 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-01-05T16:48:52.832 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146 2024-01-05T16:48:55.985 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-05T16:48:58.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-05T16:48:59.036 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-01-05T16:48:59.968 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2024-01-05T16:49:05.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-05T16:49:05.969 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-05T16:49:08.092 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-01-05T16:49:09.024 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2024-01-05T16:49:14.093 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-05T16:49:15.025 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-05T16:49:17.148 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-01-05T16:49:18.076 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2024-01-05T16:49:23.149 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-05T16:49:24.077 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-05T16:49:24.291 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-05T16:49:24.292 DEBUG:teuthology.orchestra.run.smithi069:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-05T16:49:26.208 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-01-05T16:49:32.209 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-05T16:49:35.260 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-01-05T16:49:41.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-05T16:49:44.813 INFO:teuthology.provision.fog.smithi069:Node is ready 2024-01-05T16:49:44.813 DEBUG:teuthology.orchestra.run.smithi069:> hostname 2024-01-05T16:49:44.833 INFO:teuthology.orchestra.run.smithi069.stdout:smithi193 2024-01-05T16:49:44.833 DEBUG:teuthology.orchestra.run.smithi069:> grep smithi193 /etc/hosts 2024-01-05T16:49:44.892 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.193 smithi193.front.sepia.ceph.com smithi193 2024-01-05T16:49:44.893 DEBUG:teuthology.orchestra.run.smithi069:> sudo hostname smithi069 2024-01-05T16:49:44.996 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i -e 's/smithi193/smithi069/g' /etc/hosts 2024-01-05T16:49:45.026 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i -e 's/172.21.15.193/172.21.15.69/g' /etc/hosts 2024-01-05T16:49:45.097 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i -e 's/smithi193/smithi069/g' /etc/hostname 2024-01-05T16:49:45.202 DEBUG:teuthology.orchestra.run.smithi069:> sudo hostname smithi069 2024-01-05T16:49:45.232 DEBUG:teuthology.orchestra.run.smithi069:> cat /etc/os-release 2024-01-05T16:49:45.294 INFO:teuthology.orchestra.run.smithi069.stdout:NAME="CentOS Stream" 2024-01-05T16:49:45.294 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION="8" 2024-01-05T16:49:45.294 INFO:teuthology.orchestra.run.smithi069.stdout:ID="centos" 2024-01-05T16:49:45.294 INFO:teuthology.orchestra.run.smithi069.stdout:ID_LIKE="rhel fedora" 2024-01-05T16:49:45.295 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION_ID="8" 2024-01-05T16:49:45.295 INFO:teuthology.orchestra.run.smithi069.stdout:PLATFORM_ID="platform:el8" 2024-01-05T16:49:45.295 INFO:teuthology.orchestra.run.smithi069.stdout:PRETTY_NAME="CentOS Stream 8" 2024-01-05T16:49:45.295 INFO:teuthology.orchestra.run.smithi069.stdout:ANSI_COLOR="0;31" 2024-01-05T16:49:45.295 INFO:teuthology.orchestra.run.smithi069.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-01-05T16:49:45.295 INFO:teuthology.orchestra.run.smithi069.stdout:HOME_URL="https://centos.org/" 2024-01-05T16:49:45.295 INFO:teuthology.orchestra.run.smithi069.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-05T16:49:45.295 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-05T16:49:45.295 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-05T16:49:45.296 INFO:teuthology.provision.fog.smithi069:Deploy complete! 2024-01-05T16:49:45.298 DEBUG:teuthology.parallel:result is None 2024-01-05T16:49:58.835 WARNING:teuthology.provision.fog.smithi146:timed out 2024-01-05T16:50:04.837 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-05T16:50:05.139 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-05T16:50:05.139 DEBUG:teuthology.orchestra.run.smithi146:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-05T16:50:05.376 INFO:teuthology.provision.fog.smithi146:Node is ready 2024-01-05T16:50:05.377 DEBUG:teuthology.orchestra.run.smithi146:> hostname 2024-01-05T16:50:05.436 INFO:teuthology.orchestra.run.smithi146.stdout:smithi146.front.sepia.ceph.com 2024-01-05T16:50:05.436 DEBUG:teuthology.orchestra.run.smithi146:> grep smithi146.front.sepia.ceph.com /etc/hosts 2024-01-05T16:50:05.495 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.146 smithi146.front.sepia.ceph.com smithi146 2024-01-05T16:50:05.495 DEBUG:teuthology.orchestra.run.smithi146:> sudo hostname smithi146 2024-01-05T16:50:05.609 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i -e 's/smithi146.front.sepia.ceph.com/smithi146/g' /etc/hosts 2024-01-05T16:50:05.641 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i -e 's/172.21.15.146/172.21.15.146/g' /etc/hosts 2024-01-05T16:50:05.710 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i -e 's/smithi146.front.sepia.ceph.com/smithi146/g' /etc/hostname 2024-01-05T16:50:05.777 DEBUG:teuthology.orchestra.run.smithi146:> sudo hostname smithi146 2024-01-05T16:50:05.846 DEBUG:teuthology.orchestra.run.smithi146:> cat /etc/os-release 2024-01-05T16:50:05.903 INFO:teuthology.orchestra.run.smithi146.stdout:NAME="CentOS Stream" 2024-01-05T16:50:05.903 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION="8" 2024-01-05T16:50:05.904 INFO:teuthology.orchestra.run.smithi146.stdout:ID="centos" 2024-01-05T16:50:05.904 INFO:teuthology.orchestra.run.smithi146.stdout:ID_LIKE="rhel fedora" 2024-01-05T16:50:05.904 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_ID="8" 2024-01-05T16:50:05.904 INFO:teuthology.orchestra.run.smithi146.stdout:PLATFORM_ID="platform:el8" 2024-01-05T16:50:05.904 INFO:teuthology.orchestra.run.smithi146.stdout:PRETTY_NAME="CentOS Stream 8" 2024-01-05T16:50:05.904 INFO:teuthology.orchestra.run.smithi146.stdout:ANSI_COLOR="0;31" 2024-01-05T16:50:05.904 INFO:teuthology.orchestra.run.smithi146.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-01-05T16:50:05.904 INFO:teuthology.orchestra.run.smithi146.stdout:HOME_URL="https://centos.org/" 2024-01-05T16:50:05.904 INFO:teuthology.orchestra.run.smithi146.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-05T16:50:05.904 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-05T16:50:05.904 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-05T16:50:05.905 INFO:teuthology.provision.fog.smithi146:Deploy complete! 2024-01-05T16:50:05.905 DEBUG:teuthology.parallel:result is None 2024-01-05T16:50:41.263 WARNING:teuthology.provision.fog.smithi163:timed out 2024-01-05T16:50:47.265 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-05T16:50:47.494 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-05T16:50:47.495 DEBUG:teuthology.orchestra.run.smithi163:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-05T16:50:47.797 INFO:teuthology.provision.fog.smithi163:Node is ready 2024-01-05T16:50:47.797 DEBUG:teuthology.orchestra.run.smithi163:> hostname 2024-01-05T16:50:47.817 INFO:teuthology.orchestra.run.smithi163.stdout:smithi163.front.sepia.ceph.com 2024-01-05T16:50:47.817 DEBUG:teuthology.orchestra.run.smithi163:> grep smithi163.front.sepia.ceph.com /etc/hosts 2024-01-05T16:50:47.877 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163 smithi163.front.sepia.ceph.com smithi163 2024-01-05T16:50:47.878 DEBUG:teuthology.orchestra.run.smithi163:> sudo hostname smithi163 2024-01-05T16:50:47.984 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/smithi163.front.sepia.ceph.com/smithi163/g' /etc/hosts 2024-01-05T16:50:48.014 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/172.21.15.163/172.21.15.163/g' /etc/hosts 2024-01-05T16:50:48.084 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/smithi163.front.sepia.ceph.com/smithi163/g' /etc/hostname 2024-01-05T16:50:48.164 DEBUG:teuthology.orchestra.run.smithi163:> sudo hostname smithi163 2024-01-05T16:50:48.230 DEBUG:teuthology.orchestra.run.smithi163:> cat /etc/os-release 2024-01-05T16:50:48.288 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="CentOS Stream" 2024-01-05T16:50:48.288 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="8" 2024-01-05T16:50:48.288 INFO:teuthology.orchestra.run.smithi163.stdout:ID="centos" 2024-01-05T16:50:48.288 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE="rhel fedora" 2024-01-05T16:50:48.288 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="8" 2024-01-05T16:50:48.288 INFO:teuthology.orchestra.run.smithi163.stdout:PLATFORM_ID="platform:el8" 2024-01-05T16:50:48.288 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="CentOS Stream 8" 2024-01-05T16:50:48.288 INFO:teuthology.orchestra.run.smithi163.stdout:ANSI_COLOR="0;31" 2024-01-05T16:50:48.288 INFO:teuthology.orchestra.run.smithi163.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-01-05T16:50:48.289 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://centos.org/" 2024-01-05T16:50:48.289 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-05T16:50:48.289 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-05T16:50:48.289 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-05T16:50:48.289 INFO:teuthology.provision.fog.smithi163:Deploy complete! 2024-01-05T16:50:48.289 DEBUG:teuthology.parallel:result is None 2024-01-05T16:50:48.490 INFO:teuthology.lock.ops:Checking smithi069.front.sepia.ceph.com 2024-01-05T16:50:48.491 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-05T16:50:48.516 INFO:teuthology.lock.ops:Checking smithi146.front.sepia.ceph.com 2024-01-05T16:50:48.516 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-05T16:50:48.540 INFO:teuthology.lock.ops:Checking smithi163.front.sepia.ceph.com 2024-01-05T16:50:48.540 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-05T16:50:48.558 INFO:teuthology.lock.ops:Updating [smithi069.front.sepia.ceph.com]: set os type and version on server 2024-01-05T16:50:48.558 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi069.front.sepia.ceph.com' 2024-01-05T16:50:48.558 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-05T16:50:48.624 DEBUG:teuthology.orchestra.run.smithi069:> true 2024-01-05T16:50:48.717 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi069.front.sepia.ceph.com' 2024-01-05T16:50:48.717 DEBUG:teuthology.orchestra.run.smithi069:> uname -m 2024-01-05T16:50:48.777 INFO:teuthology.orchestra.run.smithi069.stdout:x86_64 2024-01-05T16:50:48.777 DEBUG:teuthology.orchestra.run.smithi069:> cat /etc/os-release 2024-01-05T16:50:48.834 INFO:teuthology.orchestra.run.smithi069.stdout:NAME="CentOS Stream" 2024-01-05T16:50:48.834 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION="8" 2024-01-05T16:50:48.834 INFO:teuthology.orchestra.run.smithi069.stdout:ID="centos" 2024-01-05T16:50:48.835 INFO:teuthology.orchestra.run.smithi069.stdout:ID_LIKE="rhel fedora" 2024-01-05T16:50:48.835 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION_ID="8" 2024-01-05T16:50:48.835 INFO:teuthology.orchestra.run.smithi069.stdout:PLATFORM_ID="platform:el8" 2024-01-05T16:50:48.835 INFO:teuthology.orchestra.run.smithi069.stdout:PRETTY_NAME="CentOS Stream 8" 2024-01-05T16:50:48.835 INFO:teuthology.orchestra.run.smithi069.stdout:ANSI_COLOR="0;31" 2024-01-05T16:50:48.835 INFO:teuthology.orchestra.run.smithi069.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-01-05T16:50:48.835 INFO:teuthology.orchestra.run.smithi069.stdout:HOME_URL="https://centos.org/" 2024-01-05T16:50:48.835 INFO:teuthology.orchestra.run.smithi069.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-05T16:50:48.835 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-05T16:50:48.835 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-05T16:50:48.836 INFO:teuthology.lock.ops:Updating smithi069.front.sepia.ceph.com on lock server 2024-01-05T16:50:48.857 INFO:teuthology.lock.ops:Updating [smithi146.front.sepia.ceph.com]: set os type and version on server 2024-01-05T16:50:48.857 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-01-05T16:50:48.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-05T16:50:48.928 DEBUG:teuthology.orchestra.run.smithi146:> true 2024-01-05T16:50:49.062 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi146.front.sepia.ceph.com' 2024-01-05T16:50:49.062 DEBUG:teuthology.orchestra.run.smithi146:> uname -m 2024-01-05T16:50:49.121 INFO:teuthology.orchestra.run.smithi146.stdout:x86_64 2024-01-05T16:50:49.122 DEBUG:teuthology.orchestra.run.smithi146:> cat /etc/os-release 2024-01-05T16:50:49.183 INFO:teuthology.orchestra.run.smithi146.stdout:NAME="CentOS Stream" 2024-01-05T16:50:49.184 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION="8" 2024-01-05T16:50:49.184 INFO:teuthology.orchestra.run.smithi146.stdout:ID="centos" 2024-01-05T16:50:49.184 INFO:teuthology.orchestra.run.smithi146.stdout:ID_LIKE="rhel fedora" 2024-01-05T16:50:49.184 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_ID="8" 2024-01-05T16:50:49.184 INFO:teuthology.orchestra.run.smithi146.stdout:PLATFORM_ID="platform:el8" 2024-01-05T16:50:49.184 INFO:teuthology.orchestra.run.smithi146.stdout:PRETTY_NAME="CentOS Stream 8" 2024-01-05T16:50:49.184 INFO:teuthology.orchestra.run.smithi146.stdout:ANSI_COLOR="0;31" 2024-01-05T16:50:49.184 INFO:teuthology.orchestra.run.smithi146.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-01-05T16:50:49.184 INFO:teuthology.orchestra.run.smithi146.stdout:HOME_URL="https://centos.org/" 2024-01-05T16:50:49.184 INFO:teuthology.orchestra.run.smithi146.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-05T16:50:49.184 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-05T16:50:49.184 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-05T16:50:49.185 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server 2024-01-05T16:50:49.207 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: set os type and version on server 2024-01-05T16:50:49.207 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-01-05T16:50:49.207 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-05T16:50:49.272 DEBUG:teuthology.orchestra.run.smithi163:> true 2024-01-05T16:50:49.342 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-01-05T16:50:49.342 DEBUG:teuthology.orchestra.run.smithi163:> uname -m 2024-01-05T16:50:49.401 INFO:teuthology.orchestra.run.smithi163.stdout:x86_64 2024-01-05T16:50:49.401 DEBUG:teuthology.orchestra.run.smithi163:> cat /etc/os-release 2024-01-05T16:50:49.460 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="CentOS Stream" 2024-01-05T16:50:49.460 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="8" 2024-01-05T16:50:49.460 INFO:teuthology.orchestra.run.smithi163.stdout:ID="centos" 2024-01-05T16:50:49.460 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE="rhel fedora" 2024-01-05T16:50:49.460 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="8" 2024-01-05T16:50:49.460 INFO:teuthology.orchestra.run.smithi163.stdout:PLATFORM_ID="platform:el8" 2024-01-05T16:50:49.461 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="CentOS Stream 8" 2024-01-05T16:50:49.461 INFO:teuthology.orchestra.run.smithi163.stdout:ANSI_COLOR="0;31" 2024-01-05T16:50:49.461 INFO:teuthology.orchestra.run.smithi163.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-01-05T16:50:49.461 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://centos.org/" 2024-01-05T16:50:49.461 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-05T16:50:49.461 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-05T16:50:49.461 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-05T16:50:49.462 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2024-01-05T16:50:49.486 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-05T16:50:49.561 INFO:teuthology.dispatcher.supervisor:Running job 7508222 2024-01-05T16:50:49.561 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/virtualenv/bin/teuthology -v --owner scheduled_lflores@teuthology --archive /home/teuthworker/archive/lflores-2024-01-05_16:39:56-rados:thrash-old-clients-wip-read-balancer-mgr-module-distro-default-smithi/7508222 --name lflores-2024-01-05_16:39:56-rados:thrash-old-clients-wip-read-balancer-mgr-module-distro-default-smithi --description rados:thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/test_rbd_api} -- /home/teuthworker/archive/lflores-2024-01-05_16:39:56-rados:thrash-old-clients-wip-read-balancer-mgr-module-distro-default-smithi/7508222/orig.config.yaml 2024-01-05T16:50:49.564 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/lflores-2024-01-05_16:39:56-rados:thrash-old-clients-wip-read-balancer-mgr-module-distro-default-smithi/7508222 2024-01-05T16:50:49.565 INFO:teuthology.dispatcher.supervisor:Job PID: 2138595 2024-01-05T16:50:49.565 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-01-05T16:52:49.567 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-05T16:52:49.623 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-01-05T16:52:49.742 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi069 but it was locked by another job: /home/teuthworker/archive/lflores-2024-01-05_16:44:37-rados:thrash-old-clients-wip-read-balancer-mgr-module-distro-default-smithi/7508228 2024-01-05T16:52:49.742 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi146 but it was locked by another job: /home/teuthworker/archive/lflores-2024-01-05_16:44:37-rados:thrash-old-clients-wip-read-balancer-mgr-module-distro-default-smithi/7508228 2024-01-05T16:52:49.742 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi163 but it was locked by another job: /home/teuthworker/archive/lflores-2024-01-05_16:44:37-rados:thrash-old-clients-wip-read-balancer-mgr-module-distro-default-smithi/7508228