2024-02-09T18:08:50.432 INFO:root:teuthology version: 0.0.1.dev256+gd9fdb22 2024-02-09T18:08:50.433 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-09T18:08:50.579 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5332211c10>, signals=[15]) 2024-02-09T18:08:50.579 INFO:teuthology.lock.ops:Start node 'smithi103.front.sepia.ceph.com' reimaging 2024-02-09T18:08:50.579 INFO:teuthology.lock.ops:Updating [smithi103.front.sepia.ceph.com]: reset os type and version on server 2024-02-09T18:08:50.580 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server 2024-02-09T18:08:50.604 INFO:teuthology.lock.ops:Start node 'smithi145.front.sepia.ceph.com' reimaging 2024-02-09T18:08:50.605 INFO:teuthology.lock.ops:Updating [smithi145.front.sepia.ceph.com]: reset os type and version on server 2024-02-09T18:08:50.605 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server 2024-02-09T18:08:50.729 DEBUG:teuthology.provision.fog.smithi103:Requesting image smithi_ubuntu_18.04 (ID 1) 2024-02-09T18:08:50.759 DEBUG:teuthology.provision.fog.smithi145:Requesting image smithi_ubuntu_18.04 (ID 1) 2024-02-09T18:08:50.768 INFO:teuthology.provision.fog.smithi103:Scheduling deploy of ubuntu 18.04 2024-02-09T18:08:50.808 INFO:teuthology.provision.fog.smithi145:Scheduling deploy of ubuntu 18.04 2024-02-09T18:08:50.980 INFO:teuthology.orchestra.console.smithi103:Power off 2024-02-09T18:08:50.981 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-09T18:08:50.998 INFO:teuthology.orchestra.console.smithi145:Power off 2024-02-09T18:08:50.998 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-09T18:08:51.007 DEBUG:teuthology.orchestra.console.smithi103:power off output: Chassis Power Control: Down/Off 2024-02-09T18:08:51.007 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-09T18:08:51.022 DEBUG:teuthology.orchestra.console.smithi145:power off output: Chassis Power Control: Down/Off 2024-02-09T18:08:51.022 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-09T18:08:51.037 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on 2024-02-09T18:08:51.049 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is on 2024-02-09T18:08:55.040 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-09T18:08:55.050 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-09T18:08:55.150 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on 2024-02-09T18:08:55.159 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is on 2024-02-09T18:08:59.154 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-09T18:08:59.162 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-09T18:08:59.263 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off 2024-02-09T18:08:59.273 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is on 2024-02-09T18:08:59.364 INFO:teuthology.orchestra.console.smithi103:Power off completed 2024-02-09T18:08:59.465 INFO:teuthology.orchestra.console.smithi103:Power on 2024-02-09T18:08:59.465 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-09T18:08:59.488 DEBUG:teuthology.orchestra.console.smithi103:power on output: Chassis Power Control: Up/On 2024-02-09T18:08:59.489 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-09T18:08:59.513 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off 2024-02-09T18:09:03.278 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-09T18:09:03.387 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is off 2024-02-09T18:09:03.488 INFO:teuthology.orchestra.console.smithi145:Power off completed 2024-02-09T18:09:03.515 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-09T18:09:03.589 INFO:teuthology.orchestra.console.smithi145:Power on 2024-02-09T18:09:03.590 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-09T18:09:03.613 DEBUG:teuthology.orchestra.console.smithi145:power on output: Chassis Power Control: Up/On 2024-02-09T18:09:03.613 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-09T18:09:03.626 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off 2024-02-09T18:09:03.639 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is off 2024-02-09T18:09:07.628 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-09T18:09:07.640 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-09T18:09:07.738 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on 2024-02-09T18:09:07.749 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is on 2024-02-09T18:09:07.839 INFO:teuthology.orchestra.console.smithi103:Power on completed 2024-02-09T18:09:07.850 INFO:teuthology.orchestra.console.smithi145:Power on completed 2024-02-09T18:09:07.940 INFO:teuthology.provision.fog.smithi103:Waiting for deploy to finish 2024-02-09T18:09:07.950 INFO:teuthology.provision.fog.smithi145:Waiting for deploy to finish 2024-02-09T18:12:23.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:12:27.004 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-02-09T18:12:33.011 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:12:36.092 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-02-09T18:12:38.978 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:12:42.044 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-02-09T18:12:42.093 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:12:45.148 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-02-09T18:12:48.048 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:12:51.100 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-02-09T18:12:51.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:12:54.204 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-02-09T18:12:57.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:13:00.156 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-02-09T18:13:00.205 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:13:03.260 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-02-09T18:13:06.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:13:09.212 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-02-09T18:13:09.261 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:13:15.219 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:13:18.300 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-02-09T18:13:24.302 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:13:27.356 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-02-09T18:13:33.360 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:13:36.412 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-02-09T18:13:42.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:14:09.282 WARNING:teuthology.provision.fog.smithi145:timed out 2024-02-09T18:14:15.288 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:14:18.364 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-02-09T18:14:24.371 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:14:27.452 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-02-09T18:14:33.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:14:36.508 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-02-09T18:14:42.418 WARNING:teuthology.provision.fog.smithi103:timed out 2024-02-09T18:14:42.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:14:45.564 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-02-09T18:14:48.421 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:14:51.484 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-02-09T18:14:51.565 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:14:54.620 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-02-09T18:14:57.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:15:00.540 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-02-09T18:15:00.621 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:15:03.676 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-02-09T18:15:06.542 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:15:09.596 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-02-09T18:15:09.677 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:15:12.732 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-02-09T18:15:15.601 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:15:18.652 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-02-09T18:15:18.733 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:15:21.788 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-02-09T18:15:24.656 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:15:27.708 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-02-09T18:15:27.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:15:30.844 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-02-09T18:15:33.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:15:36.764 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-02-09T18:15:36.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:15:39.900 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-02-09T18:15:42.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:15:45.820 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-02-09T18:15:45.901 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:15:48.956 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-02-09T18:15:51.823 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:15:54.880 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-02-09T18:15:54.958 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:15:58.012 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-02-09T18:16:00.884 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:16:03.968 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-02-09T18:16:04.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:16:07.072 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-02-09T18:16:09.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:16:13.052 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-02-09T18:16:13.073 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:16:16.124 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-02-09T18:16:19.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:16:22.108 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-02-09T18:16:22.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:16:25.184 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-02-09T18:16:28.112 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:16:31.164 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-02-09T18:16:31.185 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:16:34.236 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-02-09T18:16:37.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:16:40.220 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-02-09T18:16:40.237 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:16:43.296 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-02-09T18:16:46.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:16:49.276 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-02-09T18:16:49.297 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:16:52.348 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-02-09T18:16:55.281 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:16:58.332 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-02-09T18:16:58.349 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:17:01.404 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-02-09T18:17:04.337 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:17:07.391 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-02-09T18:17:07.405 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:17:10.460 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-02-09T18:17:13.392 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:17:16.448 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-02-09T18:17:16.461 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:17:19.516 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-02-09T18:17:22.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:17:25.520 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:17:25.532 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-02-09T18:17:28.572 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-02-09T18:17:31.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:17:34.575 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:17:34.588 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-02-09T18:17:37.631 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-02-09T18:17:40.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:17:43.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:17:43.644 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-02-09T18:17:46.684 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-02-09T18:17:49.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:17:52.688 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:17:52.704 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-02-09T18:17:55.740 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-02-09T18:17:58.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:18:01.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:18:01.788 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-02-09T18:18:04.796 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-02-09T18:18:07.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:18:10.800 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:18:10.844 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-02-09T18:18:13.852 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-02-09T18:18:16.845 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:18:19.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:18:19.936 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-02-09T18:18:20.093 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-09T18:18:20.093 DEBUG:teuthology.orchestra.run.smithi145:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-09T18:18:25.938 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:18:28.988 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-02-09T18:18:34.989 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:18:38.048 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-02-09T18:18:40.825 INFO:teuthology.provision.fog.smithi145:Node is ready 2024-02-09T18:18:40.826 DEBUG:teuthology.orchestra.run.smithi145:> hostname 2024-02-09T18:18:40.832 INFO:teuthology.orchestra.run.smithi145.stdout:smithi145.front.sepia.ceph.com 2024-02-09T18:18:40.833 DEBUG:teuthology.orchestra.run.smithi145:> grep smithi145.front.sepia.ceph.com /etc/hosts 2024-02-09T18:18:40.880 INFO:teuthology.orchestra.run.smithi145.stdout:172.21.15.145 smithi145.front.sepia.ceph.com smithi145 2024-02-09T18:18:40.880 DEBUG:teuthology.orchestra.run.smithi145:> sudo hostname smithi145 2024-02-09T18:18:40.980 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/smithi145.front.sepia.ceph.com/smithi145/g' /etc/hosts 2024-02-09T18:18:40.996 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/172.21.15.145/172.21.15.145/g' /etc/hosts 2024-02-09T18:18:41.052 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/smithi145.front.sepia.ceph.com/smithi145/g' /etc/hostname 2024-02-09T18:18:41.108 DEBUG:teuthology.orchestra.run.smithi145:> sudo hostname smithi145 2024-02-09T18:18:41.163 DEBUG:teuthology.orchestra.run.smithi145:> cat /etc/os-release 2024-02-09T18:18:41.211 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="Ubuntu" 2024-02-09T18:18:41.211 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="18.04.6 LTS (Bionic Beaver)" 2024-02-09T18:18:41.211 INFO:teuthology.orchestra.run.smithi145.stdout:ID=ubuntu 2024-02-09T18:18:41.212 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE=debian 2024-02-09T18:18:41.212 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="Ubuntu 18.04.6 LTS" 2024-02-09T18:18:41.212 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="18.04" 2024-02-09T18:18:41.212 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://www.ubuntu.com/" 2024-02-09T18:18:41.212 INFO:teuthology.orchestra.run.smithi145.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-02-09T18:18:41.212 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-02-09T18:18:41.212 INFO:teuthology.orchestra.run.smithi145.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-02-09T18:18:41.212 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_CODENAME=bionic 2024-02-09T18:18:41.212 INFO:teuthology.orchestra.run.smithi145.stdout:UBUNTU_CODENAME=bionic 2024-02-09T18:18:41.213 INFO:teuthology.provision.fog.smithi145:Deploy complete! 2024-02-09T18:18:41.215 DEBUG:teuthology.parallel:result is None 2024-02-09T18:18:44.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:18:44.850 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-09T18:18:44.851 DEBUG:teuthology.orchestra.run.smithi103:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-09T18:19:07.436 INFO:teuthology.provision.fog.smithi103:Node is ready 2024-02-09T18:19:07.436 DEBUG:teuthology.orchestra.run.smithi103:> hostname 2024-02-09T18:19:07.443 INFO:teuthology.orchestra.run.smithi103.stdout:smithi103.front.sepia.ceph.com 2024-02-09T18:19:07.443 DEBUG:teuthology.orchestra.run.smithi103:> grep smithi103.front.sepia.ceph.com /etc/hosts 2024-02-09T18:19:07.493 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103 smithi103.front.sepia.ceph.com smithi103 2024-02-09T18:19:07.493 DEBUG:teuthology.orchestra.run.smithi103:> sudo hostname smithi103 2024-02-09T18:19:07.599 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/smithi103.front.sepia.ceph.com/smithi103/g' /etc/hosts 2024-02-09T18:19:07.613 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/172.21.15.103/172.21.15.103/g' /etc/hosts 2024-02-09T18:19:07.672 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/smithi103.front.sepia.ceph.com/smithi103/g' /etc/hostname 2024-02-09T18:19:07.728 DEBUG:teuthology.orchestra.run.smithi103:> sudo hostname smithi103 2024-02-09T18:19:07.785 DEBUG:teuthology.orchestra.run.smithi103:> cat /etc/os-release 2024-02-09T18:19:07.832 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="Ubuntu" 2024-02-09T18:19:07.832 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="18.04.6 LTS (Bionic Beaver)" 2024-02-09T18:19:07.832 INFO:teuthology.orchestra.run.smithi103.stdout:ID=ubuntu 2024-02-09T18:19:07.833 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE=debian 2024-02-09T18:19:07.833 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="Ubuntu 18.04.6 LTS" 2024-02-09T18:19:07.833 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="18.04" 2024-02-09T18:19:07.833 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://www.ubuntu.com/" 2024-02-09T18:19:07.833 INFO:teuthology.orchestra.run.smithi103.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-02-09T18:19:07.833 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-02-09T18:19:07.833 INFO:teuthology.orchestra.run.smithi103.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-02-09T18:19:07.833 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_CODENAME=bionic 2024-02-09T18:19:07.833 INFO:teuthology.orchestra.run.smithi103.stdout:UBUNTU_CODENAME=bionic 2024-02-09T18:19:07.833 INFO:teuthology.provision.fog.smithi103:Deploy complete! 2024-02-09T18:19:07.834 DEBUG:teuthology.parallel:result is None 2024-02-09T18:19:08.041 INFO:teuthology.lock.ops:Checking smithi103.front.sepia.ceph.com 2024-02-09T18:19:08.041 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-09T18:19:08.064 INFO:teuthology.lock.ops:Checking smithi145.front.sepia.ceph.com 2024-02-09T18:19:08.064 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-09T18:19:08.090 INFO:teuthology.lock.ops:Updating [smithi103.front.sepia.ceph.com]: set os type and version on server 2024-02-09T18:19:08.090 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-02-09T18:19:08.091 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:19:08.172 DEBUG:teuthology.orchestra.run.smithi103:> true 2024-02-09T18:19:08.337 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-02-09T18:19:08.337 DEBUG:teuthology.orchestra.run.smithi103:> uname -m 2024-02-09T18:19:08.384 INFO:teuthology.orchestra.run.smithi103.stdout:x86_64 2024-02-09T18:19:08.384 DEBUG:teuthology.orchestra.run.smithi103:> cat /etc/os-release 2024-02-09T18:19:08.432 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="Ubuntu" 2024-02-09T18:19:08.432 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="18.04.6 LTS (Bionic Beaver)" 2024-02-09T18:19:08.432 INFO:teuthology.orchestra.run.smithi103.stdout:ID=ubuntu 2024-02-09T18:19:08.433 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE=debian 2024-02-09T18:19:08.433 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="Ubuntu 18.04.6 LTS" 2024-02-09T18:19:08.433 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="18.04" 2024-02-09T18:19:08.433 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://www.ubuntu.com/" 2024-02-09T18:19:08.433 INFO:teuthology.orchestra.run.smithi103.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-02-09T18:19:08.433 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-02-09T18:19:08.433 INFO:teuthology.orchestra.run.smithi103.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-02-09T18:19:08.433 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_CODENAME=bionic 2024-02-09T18:19:08.433 INFO:teuthology.orchestra.run.smithi103.stdout:UBUNTU_CODENAME=bionic 2024-02-09T18:19:08.433 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server 2024-02-09T18:19:08.456 INFO:teuthology.lock.ops:Updating [smithi145.front.sepia.ceph.com]: set os type and version on server 2024-02-09T18:19:08.456 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-02-09T18:19:08.456 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T18:19:08.536 DEBUG:teuthology.orchestra.run.smithi145:> true 2024-02-09T18:19:08.701 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-02-09T18:19:08.701 DEBUG:teuthology.orchestra.run.smithi145:> uname -m 2024-02-09T18:19:08.747 INFO:teuthology.orchestra.run.smithi145.stdout:x86_64 2024-02-09T18:19:08.748 DEBUG:teuthology.orchestra.run.smithi145:> cat /etc/os-release 2024-02-09T18:19:08.799 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="Ubuntu" 2024-02-09T18:19:08.799 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="18.04.6 LTS (Bionic Beaver)" 2024-02-09T18:19:08.799 INFO:teuthology.orchestra.run.smithi145.stdout:ID=ubuntu 2024-02-09T18:19:08.799 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE=debian 2024-02-09T18:19:08.799 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="Ubuntu 18.04.6 LTS" 2024-02-09T18:19:08.799 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="18.04" 2024-02-09T18:19:08.799 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://www.ubuntu.com/" 2024-02-09T18:19:08.800 INFO:teuthology.orchestra.run.smithi145.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-02-09T18:19:08.800 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-02-09T18:19:08.800 INFO:teuthology.orchestra.run.smithi145.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-02-09T18:19:08.800 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_CODENAME=bionic 2024-02-09T18:19:08.800 INFO:teuthology.orchestra.run.smithi145.stdout:UBUNTU_CODENAME=bionic 2024-02-09T18:19:08.800 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server 2024-02-09T18:19:08.822 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-09T18:19:08.909 INFO:teuthology.dispatcher.supervisor:Running job 7553899 2024-02-09T18:19:08.909 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-02-09_15:03:10-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7553899 --name yuriw-2024-02-09_15:03:10-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi --description rados/cephadm/with-work/{0-distro/ubuntu_18.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} -- /home/teuthworker/archive/yuriw-2024-02-09_15:03:10-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7553899/orig.config.yaml 2024-02-09T18:19:08.913 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-02-09_15:03:10-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7553899 2024-02-09T18:19:08.913 INFO:teuthology.dispatcher.supervisor:Job PID: 700452 2024-02-09T18:19:08.913 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-02-09T18:21:09.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-09T18:23:09.194 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-09T18:25:09.363 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-09T18:27:09.541 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-09T18:29:09.705 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-09T18:29:09.780 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-02-09T18:29:09.865 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi103 but it was locked by another job: /home/teuthworker/archive/yuriw-2024-02-09_15:03:10-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7553906 2024-02-09T18:29:09.865 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi145 but it was locked by another job: /home/teuthworker/archive/yuriw-2024-02-09_15:03:10-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7553904