2020-04-07T14:54:35.758 INFO:root:teuthology version: 1.0.0-b1b3d82 2020-04-07T14:54:35.760 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/kchai-2020-04-07_14:37:58-rados-wip-kefu-testing-2020-04-07-1603-distro-basic-smithi/4931129 --description rados/cephadm/with-work/{distro/ubuntu_18.04.yaml fixed-2.yaml mode/packaged.yaml msgr/async.yaml start.yaml tasks/rados_api_tests.yaml} --verbose /tmp/teuthology-worker.9v5WNJ.tmp --block --owner scheduled_kchai@teuthology --lock --name kchai-2020-04-07_14:37:58-rados-wip-kefu-testing-2020-04-07-1603-distro-basic-smithi -- 2020-04-07T14:54:35.787 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-04-07T14:54:35.841 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/kchai-2020-04-07_14:37:58-rados-wip-kefu-testing-2020-04-07-1603-distro-basic-smithi/4931129 branch: wip-kefu-testing-2020-04-07-1603 description: rados/cephadm/with-work/{distro/ubuntu_18.04.yaml fixed-2.yaml mode/packaged.yaml msgr/async.yaml start.yaml tasks/rados_api_tests.yaml} email: null first_in_suite: false job_id: '4931129' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: kchai-2020-04-07_14:37:58-rados-wip-kefu-testing-2020-04-07-1603-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '18.04' overrides: admin_socket: branch: wip-kefu-testing-2020-04-07-1603 ceph: conf: client: debug ms: 1 global: ms type: async mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon warn on pool no app: false osd: debug filestore: 20 debug journal: 20 debug ms: 20 debug osd: 25 osd shutdown pgref assert: true log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - reached quota - but it is still running - overall HEALTH_ - \(POOL_FULL\) - \(SMALLER_PGP_NUM\) - \(CACHE_POOL_NO_HIT_SET\) - \(CACHE_POOL_NEAR_FULL\) - \(POOL_APP_NOT_ENABLED\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) sha1: f66d07eeb60a8cf6e623ab16f545b8e195f4d964 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 cephadm: cephadm_mode: cephadm-package install: ceph: sha1: f66d07eeb60a8cf6e623ab16f545b8e195f4d964 extra_packages: - cephadm workunit: branch: wip-kefu-testing-2020-04-07-2234 sha1: 2a27f6eef9dc660ad72ab6b9373d474c164cdf6a owner: scheduled_kchai@teuthology priority: 30 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - alertmanager.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - grafana.a - node-exporter.b sha1: f66d07eeb60a8cf6e623ab16f545b8e195f4d964 suite: rados suite_branch: wip-kefu-testing-2020-04-07-2234 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_wip-kefu-testing-2020-04-07-2234/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 2a27f6eef9dc660ad72ab6b9373d474c164cdf6a tasks: - install: null - cephadm: conf: mgr: debug mgr: 20 debug ms: 1 - workunit: clients: client.0: - rados/test.sh - rados/test_pool_quota.sh teuthology_branch: wip-py3 tube: smithi verbose: false worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.27844 2020-04-07T14:54:35.842 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_wip-kefu-testing-2020-04-07-2234/qa; will attempt to use it 2020-04-07T14:54:35.843 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_wip-kefu-testing-2020-04-07-2234/qa/tasks 2020-04-07T14:54:35.843 INFO:teuthology.run_tasks:Running task internal.check_packages... 2020-04-07T14:54:35.846 INFO:teuthology.task.internal:Checking packages... 2020-04-07T14:54:35.869 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'basic' and ceph hash 'f66d07eeb60a8cf6e623ab16f545b8e195f4d964' 2020-04-07T14:54:35.870 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-04-07T14:54:35.870 INFO:teuthology.packaging:ref: None 2020-04-07T14:54:35.871 INFO:teuthology.packaging:tag: None 2020-04-07T14:54:35.871 INFO:teuthology.packaging:branch: wip-kefu-testing-2020-04-07-1603 2020-04-07T14:54:35.871 INFO:teuthology.packaging:sha1: f66d07eeb60a8cf6e623ab16f545b8e195f4d964 2020-04-07T14:54:35.873 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&ref=wip-kefu-testing-2020-04-07-1603 2020-04-07T14:54:36.117 INFO:teuthology.task.internal:Found packages for ceph version 16.0.0-486-gf66d07e-1bionic 2020-04-07T14:54:36.117 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2020-04-07T14:54:36.127 INFO:teuthology.task.internal:no buildpackages task found 2020-04-07T14:54:36.128 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2020-04-07T14:54:36.158 INFO:teuthology.task.internal.lock_machines:Locking machines... 2020-04-07T14:54:36.159 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-04-07T14:54:36.205 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-07T14:54:46.222 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-07T14:54:56.237 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-07T14:55:06.255 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-07T14:55:16.273 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-07T14:55:26.292 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T14:55:36.310 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T14:55:46.324 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T14:55:56.342 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-07T14:56:06.358 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T14:56:16.377 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T14:56:26.390 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T14:56:36.405 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T14:56:46.423 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T14:56:56.441 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T14:57:06.457 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T14:57:16.474 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T14:57:26.492 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T14:57:36.509 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T14:57:46.531 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T14:57:56.545 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T14:58:06.562 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T14:58:16.585 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T14:58:26.600 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T14:58:36.617 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T14:58:46.627 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T14:58:56.646 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T14:59:06.664 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T14:59:16.681 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T14:59:26.697 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T14:59:36.714 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T14:59:46.728 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-07T14:59:56.745 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:00:06.760 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-07T15:00:16.784 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-07T15:00:26.803 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:00:36.822 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:00:46.836 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:00:56.853 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:01:06.886 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:01:16.905 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:01:26.922 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:01:36.935 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:01:46.952 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:01:56.970 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:02:06.984 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-07T15:02:16.998 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:02:27.009 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:02:37.027 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:02:47.045 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:02:57.062 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:03:07.078 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:03:17.092 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:03:27.106 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:03:37.124 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-07T15:03:47.141 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:03:57.157 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:04:07.175 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-07T15:04:17.189 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-07T15:04:27.209 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-07T15:04:37.224 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:04:47.242 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:04:57.261 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-07T15:05:07.280 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:05:17.297 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:05:27.313 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:05:37.328 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:05:47.346 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:05:57.362 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:06:07.377 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:06:17.397 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:06:27.408 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:06:37.425 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:06:47.441 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:06:57.457 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:07:07.474 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:07:17.489 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:07:27.505 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:07:37.523 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:07:47.541 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:07:57.559 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2020-04-07T15:08:07.574 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:08:17.590 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:08:27.602 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:08:37.616 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:08:47.634 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:08:57.649 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:09:07.664 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:09:17.681 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:09:27.701 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:09:37.717 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:09:47.734 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:09:57.750 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:10:07.771 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:10:17.792 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:10:27.811 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:10:37.829 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:10:47.858 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:10:57.873 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:11:07.889 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:11:17.905 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:11:27.921 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:11:37.937 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:11:47.946 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:11:57.963 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:12:07.979 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2020-04-07T15:12:17.993 DEBUG:teuthology.lock.ops:lock_many request: {'machine_type': 'smithi', 'description': '/home/teuthworker/archive/kchai-2020-04-07_14:37:58-rados-wip-kefu-testing-2020-04-07-1603-distro-basic-smithi/4931129', 'count': 2, 'locked_by': 'scheduled_kchai@teuthology'} 2020-04-07T15:12:18.010 DEBUG:teuthology.lock.ops:locked ubuntu@smithi051.front.sepia.ceph.com, ubuntu@smithi131.front.sepia.ceph.com 2020-04-07T15:12:18.079 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f148870a950>, signals=[15]) 2020-04-07T15:12:18.268 INFO:teuthology.provision.fog.smithi131:Scheduling deploy of ubuntu 18.04 2020-04-07T15:12:18.293 INFO:teuthology.provision.fog.smithi051:Scheduling deploy of ubuntu 18.04 2020-04-07T15:12:18.588 INFO:teuthology.orchestra.console:Power off smithi131 2020-04-07T15:12:18.589 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-04-07T15:12:18.615 INFO:teuthology.orchestra.console:Power off smithi051 2020-04-07T15:12:18.616 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi051.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-04-07T15:12:18.624 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-07T15:12:18.640 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi051.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-07T15:12:22.665 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-07T15:12:22.672 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi051.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-07T15:12:26.779 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-07T15:12:26.799 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi051.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-07T15:12:26.989 INFO:teuthology.orchestra.console:Power off for smithi131 completed 2020-04-07T15:12:27.010 INFO:teuthology.orchestra.console:Power off for smithi051 completed 2020-04-07T15:12:27.090 INFO:teuthology.orchestra.console:Power on smithi131 2020-04-07T15:12:27.091 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-04-07T15:12:27.115 INFO:teuthology.orchestra.console:Power on smithi051 2020-04-07T15:12:27.115 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi051.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-04-07T15:12:27.139 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-07T15:12:27.169 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi051.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-07T15:12:31.181 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-07T15:12:31.190 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi051.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-07T15:12:35.293 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-07T15:12:35.301 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi051.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-04-07T15:12:35.511 INFO:teuthology.orchestra.console:Power on for smithi131 completed 2020-04-07T15:12:35.513 INFO:teuthology.orchestra.console:Power on for smithi051 completed 2020-04-07T15:12:35.613 INFO:teuthology.provision.fog.smithi131:Waiting for deploy to finish 2020-04-07T15:12:35.617 INFO:teuthology.provision.fog.smithi051:Waiting for deploy to finish 2020-04-07T15:13:57.566 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2020-04-07T15:13:57.569 DEBUG:teuthology.task.console_log:Killing console logger for smithi131 2020-04-07T15:13:57.569 DEBUG:teuthology.task.console_log:Killing console logger for smithi051 2020-04-07T15:13:57.570 DEBUG:teuthology.exit:Finished running handlers