2020-11-23T13:44:56.033 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-23T13:45:06.052 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-11-23T13:45:16.069 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-23T13:45:26.087 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-23T13:45:36.099 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-23T13:45:46.117 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-23T13:45:56.132 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-23T13:46:06.150 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-23T13:46:16.164 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-23T13:46:26.180 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-23T13:46:36.197 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-11-23T13:46:46.213 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-11-23T13:46:56.228 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-23T13:47:06.238 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-11-23T13:47:16.257 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-23T13:47:26.274 DEBUG:teuthology.lock.ops:lock_many request: {'locked_by': 'scheduled_teuthology@teuthology', 'count': 2, 'machine_type': 'smithi', 'description': '/home/teuthworker/archive/teuthology-2020-11-23_03:05:03-rgw-master-distro-basic-smithi/5647454'} 2020-11-23T13:47:26.298 ERROR:teuthology.lock.ops:Insufficient nodes available to lock 2 smithi nodes. 2020-11-23T13:47:26.299 ERROR:teuthology.lock.ops:{"message": "only 0 nodes available"} 2020-11-23T13:47:26.299 INFO:teuthology.task.internal.lock_machines:0 smithi machines locked this try, 0/2 locked so far 2020-11-23T13:47:26.300 INFO:teuthology.task.internal.lock_machines:0 machines locked (0 new); need 2 more 2020-11-23T13:47:26.300 WARNING:teuthology.task.internal.lock_machines:Could not lock enough machines, waiting... 2020-11-23T13:47:36.318 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-23T13:47:46.333 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-23T13:47:56.351 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-11-23T13:48:06.369 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-11-23T13:48:16.387 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-11-23T13:48:26.402 DEBUG:teuthology.lock.ops:lock_many request: {'locked_by': 'scheduled_teuthology@teuthology', 'count': 2, 'machine_type': 'smithi', 'description': '/home/teuthworker/archive/teuthology-2020-11-23_03:05:03-rgw-master-distro-basic-smithi/5647454'} 2020-11-23T13:48:26.438 ERROR:teuthology.lock.ops:Insufficient nodes available to lock 2 smithi nodes. 2020-11-23T13:48:26.438 ERROR:teuthology.lock.ops:{"message": "only 1 nodes available"} 2020-11-23T13:48:26.439 INFO:teuthology.task.internal.lock_machines:0 smithi machines locked this try, 0/2 locked so far 2020-11-23T13:48:26.439 INFO:teuthology.task.internal.lock_machines:0 machines locked (0 new); need 2 more 2020-11-23T13:48:26.440 WARNING:teuthology.task.internal.lock_machines:Could not lock enough machines, waiting... 2020-11-23T13:48:36.458 DEBUG:teuthology.lock.ops:lock_many request: {'locked_by': 'scheduled_teuthology@teuthology', 'count': 2, 'machine_type': 'smithi', 'description': '/home/teuthworker/archive/teuthology-2020-11-23_03:05:03-rgw-master-distro-basic-smithi/5647454'} 2020-11-23T13:48:36.487 DEBUG:teuthology.lock.ops:locked ubuntu@smithi198.front.sepia.ceph.com, ubuntu@smithi165.front.sepia.ceph.com 2020-11-23T13:48:36.553 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7efe31663ea0>, signals=[15]) 2020-11-23T13:48:36.803 INFO:teuthology.provision.fog.smithi165:Scheduling deploy of centos 8.0 2020-11-23T13:48:36.940 INFO:teuthology.provision.fog.smithi198:Scheduling deploy of centos 8.0 2020-11-23T13:48:38.047 INFO:teuthology.orchestra.console:Power off smithi165 2020-11-23T13:48:38.048 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-11-23T13:48:38.071 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-23T13:48:38.158 INFO:teuthology.orchestra.console:Power off smithi198 2020-11-23T13:48:38.159 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi198.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-11-23T13:48:38.179 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi198.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-23T13:48:38.192 INFO:teuthology.orchestra.console:Power off for smithi165 completed 2020-11-23T13:48:38.294 INFO:teuthology.orchestra.console:Power on smithi165 2020-11-23T13:48:38.294 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-11-23T13:48:38.303 INFO:teuthology.orchestra.console:Power off for smithi198 completed 2020-11-23T13:48:38.313 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-23T13:48:38.405 INFO:teuthology.orchestra.console:Power on smithi198 2020-11-23T13:48:38.406 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi198.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-11-23T13:48:38.426 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi198.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-23T13:48:42.337 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-23T13:48:42.446 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi198.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-23T13:48:46.461 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi165.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-23T13:48:46.557 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi198.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-23T13:48:46.678 INFO:teuthology.orchestra.console:Power on for smithi165 completed 2020-11-23T13:48:46.777 INFO:teuthology.orchestra.console:Power on for smithi198 completed 2020-11-23T13:48:46.781 INFO:teuthology.provision.fog.smithi165:Waiting for deploy to finish 2020-11-23T13:48:46.881 INFO:teuthology.provision.fog.smithi198:Waiting for deploy to finish 2020-11-23T13:51:20.285 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi198.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-23T13:51:20.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-23T13:51:29.417 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi198.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-23T13:51:29.734 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-23T13:51:38.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi198.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-23T13:51:38.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-23T13:51:47.531 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi198.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-23T13:51:47.850 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-23T13:51:56.586 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi198.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-23T13:51:56.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-23T13:52:05.641 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi198.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-23T13:52:05.958 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}