2019-12-24T21:22:44.014 INFO:root:teuthology version: 1.0.0-ebb2eff 2019-12-24T21:22:44.014 DEBUG:teuthology.run:Teuthology command: teuthology /tmp/teuthology-worker.xiRL9B.tmp -- --verbose --lock --description rados:thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-install/jewel-v1only.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/off.yaml distro$/{centos_7.6.yaml} msgr-failures/osd-delay.yaml rados.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} --name sage-2019-12-24_21:11:08-rados:thrash-old-clients-wip-sage-testing-2019-12-23-1810-distro-basic-smithi --block --owner scheduled_sage@teuthology --archive /home/teuthworker/archive/sage-2019-12-24_21:11:08-rados:thrash-old-clients-wip-sage-testing-2019-12-23-1810-distro-basic-smithi/4630508 2019-12-24T21:22:44.094 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2019-12-24T21:22:44.146 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/sage-2019-12-24_21:11:08-rados:thrash-old-clients-wip-sage-testing-2019-12-23-1810-distro-basic-smithi/4630508 branch: wip-sage-testing-2019-12-23-1810 description: rados:thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-install/jewel-v1only.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/off.yaml distro$/{centos_7.6.yaml} msgr-failures/osd-delay.yaml rados.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} email: null first_in_suite: false job_id: '4630508' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: sage-2019-12-24_21:11:08-rados:thrash-old-clients-wip-sage-testing-2019-12-23-1810-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 30 - volumes: count: 4 size: 10 os_type: centos os_version: '7.6' overrides: admin_socket: branch: wip-sage-testing-2019-12-23-1810 ceph: conf: global: mon client directed command retry: 5 ms bind msgr2: false ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: osd ms inject internal delays: 0.002 ms inject socket failures: 2500 ms type: async osd_pool_default_min_size: 2 osd_pool_default_size: 3 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 paxos service trim min: 10 osd: debug filestore: 20 debug journal: 20 debug ms: 1 debug osd: 25 osd backoff on degraded: true osd backoff on peering: true osd debug verify cached snaps: true osd debug verify missing on start: true osd map cache size: 1 osd max backfills: 6 osd op queue: debug_random osd op queue cut off: debug_random osd scrub during recovery: false osd scrub max interval: 120 osd scrub min interval: 60 osd shutdown pgref assert: true log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(MON_DOWN\) - \(OSD_SLOW_PING_TIME - but it is still running - objects unfound and apparently lost - osd_map_cache_size - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow requests mon_bind_msgr2: false sha1: 7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: sha1: 7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 thrashosds: min_in: 4 workunit: branch: wip-cephadm-cot sha1: ae3ed51e14ccef082d0470205ec570125f0f3d4f owner: scheduled_sage@teuthology priority: 30 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - - mon.c - osd.8 - osd.9 - osd.10 - osd.11 - client.2 sha1: 7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 suite: rados:thrash-old-clients suite_branch: wip-cephadm-cot suite_path: /home/teuthworker/src/github.com_liewegas_ceph_wip-cephadm-cot/qa suite_relpath: qa suite_repo: https://github.com/liewegas/ceph suite_sha1: ae3ed51e14ccef082d0470205ec570125f0f3d4f tasks: - install: branch: jewel exclude_packages: - librados3 - ceph-mgr-dashboard - ceph-mgr-diskprediction-local - ceph-mgr-rook - ceph-mgr-cephadm - cephadm - ceph-mgr - libcephfs2 - libcephfs-devel - libcephfs-dev - ceph-immutable-object-cache - ceph-base - librados-devel - python3-rados - python3-rgw - python3-rbd - python3-cephfs extra_packages: - librados2 - python-rados - python-rbd - python-cephfs - cephadm: null - thrashosds: chance_pgnum_grow: 0.25 chance_pgpnum_fix: 0.25 chance_test_map_discontinuity: 2 timeout: 1800 - rados: clients: - client.2 objects: 50 op_weights: copy_from: 50 delete: 50 read: 100 rollback: 50 snap_create: 50 snap_remove: 50 write: 100 ops: 4000 teuthology_branch: master tube: smithi verbose: false worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.2490 2019-12-24T21:22:44.147 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_liewegas_ceph_wip-cephadm-cot/qa; will attempt to use it 2019-12-24T21:22:44.147 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_liewegas_ceph_wip-cephadm-cot/qa/tasks 2019-12-24T21:22:44.147 INFO:teuthology.run_tasks:Running task internal.check_packages... 2019-12-24T21:22:44.149 INFO:teuthology.task.internal:Checking packages... 2019-12-24T21:22:44.162 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'basic' and ceph hash '7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01' 2019-12-24T21:22:44.162 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2019-12-24T21:22:44.162 INFO:teuthology.packaging:ref: None 2019-12-24T21:22:44.162 INFO:teuthology.packaging:tag: None 2019-12-24T21:22:44.162 INFO:teuthology.packaging:branch: wip-sage-testing-2019-12-23-1810 2019-12-24T21:22:44.162 INFO:teuthology.packaging:sha1: 7b0bf1898bbd01c568f9f0e39f2f1ad1b561ef01 2019-12-24T21:22:44.163 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&ref=wip-sage-testing-2019-12-23-1810 2019-12-24T21:22:44.339 INFO:teuthology.task.internal:Found packages for ceph version 15.0.0-8840.g7b0bf18 2019-12-24T21:22:44.339 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2019-12-24T21:22:44.379 INFO:teuthology.task.internal:no buildpackages task found 2019-12-24T21:22:44.379 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2019-12-24T21:22:44.405 INFO:teuthology.task.internal.lock_machines:Locking machines... 2019-12-24T21:22:44.405 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2019-12-24T21:22:44.446 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:22:54.463 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:23:04.486 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:23:14.500 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:23:24.516 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:23:34.532 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:23:44.550 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:23:54.564 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:24:04.580 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:24:14.597 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:24:24.611 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:24:34.629 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:24:44.644 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:24:54.663 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:25:04.680 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:25:14.696 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:25:24.713 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:25:34.725 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:25:44.745 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:25:54.757 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:26:04.772 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:26:14.789 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:26:24.806 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:26:34.821 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:26:44.837 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:26:54.852 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:27:04.877 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:27:14.893 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:27:24.907 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:27:34.925 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:27:44.940 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:27:54.957 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:28:04.979 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:28:14.998 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:28:25.015 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:28:35.031 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:28:45.048 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:28:55.064 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:29:05.081 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:29:15.098 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:29:25.112 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:29:35.129 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:29:45.143 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:29:55.159 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:30:05.177 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:30:15.195 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:30:25.211 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:30:35.228 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:30:45.243 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:30:55.259 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:31:05.275 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:31:15.291 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:31:25.304 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:31:35.316 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:31:45.328 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:31:55.336 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:32:05.352 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:32:15.367 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:32:25.383 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:32:35.399 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:32:45.416 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:32:55.431 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:33:05.448 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:33:15.464 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:33:25.480 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:33:35.495 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:33:45.511 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:33:55.533 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:34:05.549 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:34:15.564 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:34:25.579 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:34:35.595 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:34:45.609 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:34:55.625 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:35:05.640 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T21:35:15.655 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:35:25.670 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:35:35.685 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:35:45.700 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:35:55.719 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:36:05.736 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:36:15.753 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:36:25.768 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:36:35.785 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:36:45.800 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:36:55.821 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:37:05.843 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:37:15.860 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:37:25.875 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:37:35.889 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:37:45.904 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:37:55.921 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:38:05.938 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:38:15.953 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:38:25.968 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:38:35.986 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:38:46.000 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:38:56.016 DEBUG:teuthology.lock.ops:lock_many request: {'count': 3, 'locked_by': 'scheduled_sage@teuthology', 'description': '/home/teuthworker/archive/sage-2019-12-24_21:11:08-rados:thrash-old-clients-wip-sage-testing-2019-12-23-1810-distro-basic-smithi/4630508', 'machine_type': 'smithi'} 2019-12-24T21:38:56.031 ERROR:teuthology.lock.ops:Insufficient nodes available to lock 3 smithi nodes. 2019-12-24T21:38:56.031 ERROR:teuthology.lock.ops:{"message": "only 2 nodes available"} 2019-12-24T21:38:56.031 INFO:teuthology.task.internal.lock_machines:0 smithi machines locked this try, 0/3 locked so far 2019-12-24T21:38:56.031 INFO:teuthology.task.internal.lock_machines:0 machines locked (0 new); need 3 more 2019-12-24T21:38:56.031 WARNING:teuthology.task.internal.lock_machines:Could not lock enough machines, waiting... 2019-12-24T21:39:06.049 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:39:16.064 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:39:26.079 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:39:36.092 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:39:46.109 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:39:56.126 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:40:06.141 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:40:16.152 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:40:26.165 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:40:36.178 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:40:46.192 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:40:56.208 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:41:06.224 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:41:16.235 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:41:26.257 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:41:36.272 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:41:46.288 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:41:56.304 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:42:06.320 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:42:16.337 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:42:26.353 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:42:36.368 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:42:46.383 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:42:56.403 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:43:06.420 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:43:16.436 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:43:26.448 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:43:36.465 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:43:46.482 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:43:56.497 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:44:06.512 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:44:16.529 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:44:26.545 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:44:36.561 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:44:46.578 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:44:56.597 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:45:06.612 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:45:16.624 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:45:26.641 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:45:36.658 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:45:46.673 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:45:56.688 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:46:06.703 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:46:16.718 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:46:26.728 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:46:36.746 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:46:46.759 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:46:56.777 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:47:06.792 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:47:16.808 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:47:26.824 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:47:36.841 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:47:46.856 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:47:56.871 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:48:06.888 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:48:16.897 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:48:26.913 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:48:36.928 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:48:46.945 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:48:56.960 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:49:06.977 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:49:16.995 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:49:27.012 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:49:37.029 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:49:47.044 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:49:57.062 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:50:07.076 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:50:17.093 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T21:50:27.107 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:50:37.124 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:50:47.141 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:50:57.156 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:51:07.172 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:51:17.189 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:51:27.204 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:51:37.220 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:51:47.237 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:51:57.253 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:52:07.270 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T21:52:17.289 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T21:52:27.305 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T21:52:37.321 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T21:52:47.336 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T21:52:57.357 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T21:53:07.374 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T21:53:17.388 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T21:53:27.404 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T21:53:37.420 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T21:53:47.435 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T21:53:57.458 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T21:54:07.477 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T21:54:17.492 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T21:54:27.507 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T21:54:37.525 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T21:54:47.542 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T21:54:57.556 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T21:55:07.573 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T21:55:17.589 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T21:55:27.607 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T21:55:37.624 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T21:55:47.641 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T21:55:57.657 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T21:56:07.669 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T21:56:17.684 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T21:56:27.700 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:56:37.716 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:56:47.727 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:56:57.739 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:57:07.756 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:57:17.772 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:57:27.787 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:57:37.804 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:57:47.820 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:57:57.836 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:58:07.853 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:58:17.869 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:58:27.881 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:58:37.895 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:58:47.907 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T21:58:57.924 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T21:59:07.940 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:59:17.948 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:59:27.965 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:59:37.982 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:59:47.998 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T21:59:58.013 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:00:08.028 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:00:18.044 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:00:28.053 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:00:38.070 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:00:48.088 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:00:58.104 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:01:08.121 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:01:18.136 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:01:28.153 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:01:38.164 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:01:48.180 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:01:58.196 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:02:08.212 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:02:18.228 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:02:28.246 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:02:38.263 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:02:48.280 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:02:58.291 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:03:08.303 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:03:18.320 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:03:28.329 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:03:38.343 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:03:48.359 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 1)... 2019-12-24T22:03:58.377 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 1)... 2019-12-24T22:04:08.394 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 1)... 2019-12-24T22:04:18.407 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 1)... 2019-12-24T22:04:28.423 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 1)... 2019-12-24T22:04:38.440 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:04:48.460 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:04:58.476 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:05:08.493 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:05:18.508 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:05:28.524 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:05:38.540 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:05:48.556 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:05:58.572 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:06:08.599 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:06:18.619 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:06:28.637 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:06:38.654 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:06:48.669 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:06:58.684 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:07:08.700 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:07:18.716 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:07:28.749 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:07:38.762 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:07:48.776 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:07:58.794 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:08:08.805 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:08:18.819 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:08:28.837 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:08:38.853 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:08:48.861 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:08:58.879 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:09:08.888 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:09:18.904 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:09:28.920 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:09:38.932 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:09:48.947 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:09:58.956 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:10:08.972 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:10:18.988 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:10:29.002 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:10:39.017 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:10:49.033 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:10:59.049 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:11:09.064 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:11:19.080 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:11:29.096 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:11:39.109 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:11:49.124 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:11:59.141 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:12:09.159 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:12:19.172 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:12:29.188 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:12:39.205 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:12:49.228 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:12:59.244 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:13:09.269 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:13:19.293 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:13:29.314 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:13:39.328 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:13:49.346 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:13:59.363 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:14:09.377 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:14:19.392 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:14:29.405 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:14:39.420 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:14:49.436 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:14:59.453 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:15:09.469 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:15:19.484 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:15:29.500 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:15:39.517 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:15:49.534 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:15:59.552 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:16:09.569 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:16:19.585 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:16:29.601 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:16:39.616 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:16:49.632 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:16:59.649 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:17:09.665 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:17:19.683 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:17:29.699 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:17:39.720 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:17:49.737 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:17:59.752 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:18:09.768 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:18:19.785 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:18:29.800 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:18:39.824 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:18:49.840 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:18:59.857 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:19:09.873 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:19:19.888 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:19:29.909 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:19:39.924 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:19:49.940 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:19:59.956 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:20:09.972 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:20:19.988 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:20:30.004 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:20:40.021 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:20:50.035 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:21:00.052 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:21:10.062 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:21:20.077 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:21:30.105 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:21:40.122 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:21:50.139 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:22:00.156 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:22:10.178 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:22:20.195 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:22:30.212 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:22:40.230 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:22:50.244 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:23:00.259 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:23:10.275 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:23:20.292 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:23:30.312 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:23:40.329 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:23:50.344 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:24:00.366 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:24:10.380 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:24:20.397 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:24:30.413 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:24:40.428 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:24:50.440 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:25:00.457 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:25:10.474 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:25:20.488 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:25:30.504 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:25:40.520 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:25:50.536 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:26:00.552 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:26:10.568 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:26:20.588 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:26:30.605 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:26:40.620 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:26:50.636 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:27:00.653 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:27:10.667 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:27:20.684 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:27:30.695 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:27:40.711 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:27:50.721 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:28:00.735 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:28:10.753 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:28:20.768 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:28:30.785 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:28:40.802 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:28:50.822 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:29:00.840 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:29:10.856 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:29:20.872 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:29:30.888 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:29:40.905 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:29:50.923 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:30:00.949 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:30:10.967 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:30:20.985 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:30:31.002 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:30:41.021 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:30:51.037 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:31:01.052 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:31:11.067 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:31:21.089 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:31:31.104 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:31:41.120 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:31:51.136 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:32:01.151 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:32:11.168 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:32:21.182 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:32:31.197 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:32:41.215 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:32:51.232 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:33:01.247 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:33:11.264 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:33:21.280 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:33:31.294 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:33:41.307 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:33:51.323 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:34:01.339 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:34:11.354 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:34:21.367 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:34:31.383 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:34:41.397 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:34:51.407 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:35:01.430 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:35:11.447 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:35:21.465 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:35:31.479 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:35:41.496 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:35:51.512 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:36:01.521 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:36:11.536 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:36:21.555 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:36:31.566 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:36:41.579 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:36:51.599 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:37:01.615 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:37:11.631 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:37:21.648 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:37:31.663 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T22:37:41.680 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T22:37:51.697 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T22:38:01.713 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T22:38:11.730 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T22:38:21.745 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)... 2019-12-24T22:38:31.759 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:38:41.777 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:38:51.785 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:39:01.798 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:39:11.806 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:39:21.944 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:39:31.960 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:39:41.976 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:39:51.991 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:40:02.008 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:40:12.023 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:40:22.039 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:40:32.051 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:40:42.065 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:40:52.074 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:41:02.087 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:41:12.103 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:41:22.119 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:41:32.137 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:41:42.153 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:41:52.169 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:42:02.184 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:42:12.199 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:42:22.216 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:42:32.232 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:42:42.247 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:42:52.261 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:43:02.277 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:43:12.293 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:43:22.308 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:43:32.323 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:43:42.339 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:43:52.356 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:44:02.377 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:44:12.393 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:44:22.409 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:44:32.425 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:44:42.442 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:44:52.456 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:45:02.474 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:45:12.487 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:45:22.504 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:45:32.524 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:45:42.540 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:45:52.558 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:46:02.574 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:46:12.589 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:46:22.604 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:46:32.620 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:46:42.637 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:46:52.652 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:47:02.670 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:47:12.685 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:47:22.700 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:47:32.717 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:47:42.729 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:47:52.744 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:48:02.758 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:48:12.769 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:48:22.784 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:48:32.800 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:48:42.816 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:48:52.833 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:49:02.853 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:49:12.869 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:49:22.885 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:49:32.900 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:49:42.917 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:49:52.933 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:50:02.949 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:50:12.968 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:50:22.986 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:50:33.000 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:50:43.017 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:50:53.032 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:51:03.048 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:51:13.064 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:51:23.082 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:51:33.095 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:51:43.121 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:51:53.137 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:52:03.148 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:52:13.165 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:52:23.180 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:52:33.197 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:52:43.212 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:52:53.228 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:53:03.245 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:53:13.264 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:53:23.280 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:53:33.305 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:53:43.321 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:53:53.338 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:54:03.356 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:54:13.372 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:54:23.387 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:54:33.409 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:54:43.423 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:54:53.439 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:55:03.454 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:55:13.466 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:55:23.480 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:55:33.496 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:55:43.521 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:55:53.534 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:56:03.562 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:56:13.575 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:56:23.594 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:56:33.611 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:56:43.630 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:56:53.645 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:57:03.660 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)... 2019-12-24T22:57:13.678 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:57:23.695 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:57:33.718 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:57:43.733 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:57:53.744 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:58:03.757 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:58:13.771 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:58:23.788 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:58:33.807 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)... 2019-12-24T22:58:43.826 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:58:53.840 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 1)... 2019-12-24T22:59:03.856 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 1)... 2019-12-24T22:59:13.873 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:59:23.890 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:59:33.905 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:59:43.923 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T22:59:53.941 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T23:00:03.959 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)... 2019-12-24T23:00:13.978 DEBUG:teuthology.lock.ops:lock_many request: {'count': 3, 'locked_by': 'scheduled_sage@teuthology', 'description': '/home/teuthworker/archive/sage-2019-12-24_21:11:08-rados:thrash-old-clients-wip-sage-testing-2019-12-23-1810-distro-basic-smithi/4630508', 'machine_type': 'smithi'} 2019-12-24T23:00:13.999 DEBUG:teuthology.lock.ops:locked ubuntu@smithi046.front.sepia.ceph.com, ubuntu@smithi130.front.sepia.ceph.com, ubuntu@smithi152.front.sepia.ceph.com 2019-12-24T23:00:14.137 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2019-12-24T23:00:14.350 INFO:teuthology.provision.fog.smithi046:Scheduling deploy of centos 7.6 2019-12-24T23:00:14.385 INFO:teuthology.provision.fog.smithi152:Scheduling deploy of centos 7.6 2019-12-24T23:00:14.416 INFO:teuthology.provision.fog.smithi130:Scheduling deploy of centos 7.6 2019-12-24T23:00:14.751 INFO:teuthology.orchestra.console:Power off smithi046 2019-12-24T23:00:14.751 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2019-12-24T23:00:14.787 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-24T23:00:14.806 INFO:teuthology.orchestra.console:Power off smithi152 2019-12-24T23:00:14.807 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2019-12-24T23:00:14.829 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-24T23:00:14.916 INFO:teuthology.orchestra.console:Power off smithi130 2019-12-24T23:00:14.916 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2019-12-24T23:00:14.941 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-24T23:00:18.817 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-24T23:00:18.854 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-24T23:00:18.968 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-24T23:00:22.932 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-24T23:00:22.966 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-24T23:00:23.080 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-24T23:00:23.147 INFO:teuthology.orchestra.console:Power off for smithi046 completed 2019-12-24T23:00:23.177 INFO:teuthology.orchestra.console:Power off for smithi152 completed 2019-12-24T23:00:23.249 INFO:teuthology.orchestra.console:Power on smithi046 2019-12-24T23:00:23.249 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2019-12-24T23:00:23.272 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-24T23:00:23.284 INFO:teuthology.orchestra.console:Power on smithi152 2019-12-24T23:00:23.284 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2019-12-24T23:00:23.295 INFO:teuthology.orchestra.console:Power off for smithi130 completed 2019-12-24T23:00:23.308 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-24T23:00:23.396 INFO:teuthology.orchestra.console:Power on smithi130 2019-12-24T23:00:23.397 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2019-12-24T23:00:23.420 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-24T23:00:27.296 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-24T23:00:27.333 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-24T23:00:27.447 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-24T23:00:31.410 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-24T23:00:31.459 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-24T23:00:31.558 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-24T23:00:31.626 INFO:teuthology.orchestra.console:Power on for smithi046 completed 2019-12-24T23:00:31.672 INFO:teuthology.orchestra.console:Power on for smithi152 completed 2019-12-24T23:00:31.734 INFO:teuthology.provision.fog.smithi046:Waiting for deploy to finish 2019-12-24T23:00:31.773 INFO:teuthology.provision.fog.smithi152:Waiting for deploy to finish 2019-12-24T23:00:31.790 INFO:teuthology.orchestra.console:Power on for smithi130 completed 2019-12-24T23:00:31.890 INFO:teuthology.provision.fog.smithi130:Waiting for deploy to finish 2019-12-24T23:03:02.921 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi046.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T23:03:02.992 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi130.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T23:03:11.981 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi046.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T23:03:12.074 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi130.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T23:03:17.983 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi152.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T23:03:21.035 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi046.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T23:03:21.129 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi130.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T23:03:27.054 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi152.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T23:03:30.090 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi046.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T23:03:30.185 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi130.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T23:03:36.107 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi152.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T23:03:39.148 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi046.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T23:03:39.241 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi130.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T23:03:45.163 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi152.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T23:03:48.202 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi046.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T23:03:48.297 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi130.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T23:03:54.217 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi152.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T23:03:57.353 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi130.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T23:04:03.277 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi152.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T23:04:12.337 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi152.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T23:04:21.420 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi152.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T23:04:54.229 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi046.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T23:04:54.456 INFO:teuthology.orchestra.run.smithi046:> hostname 2019-12-24T23:04:55.004 INFO:teuthology.orchestra.run.smithi046.stdout:smithi046.front.sepia.ceph.com 2019-12-24T23:04:55.005 INFO:teuthology.orchestra.run.smithi046:> grep smithi046.front.sepia.ceph.com /etc/hosts 2019-12-24T23:04:55.088 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2019-12-24T23:04:55.088 INFO:teuthology.orchestra.run.smithi046:> sudo hostname smithi046 2019-12-24T23:04:55.257 INFO:teuthology.orchestra.run.smithi046:> sudo sed -i -e 's/smithi046.front.sepia.ceph.com/smithi046/g' /etc/hosts 2019-12-24T23:04:55.355 INFO:teuthology.orchestra.run.smithi046:> sudo sed -i -e 's/172.21.15.46/172.21.15.46/g' /etc/hosts 2019-12-24T23:04:55.447 INFO:teuthology.orchestra.run.smithi046:> sudo sed -i -e 's/smithi046.front.sepia.ceph.com/smithi046/g' /etc/hostname 2019-12-24T23:04:55.527 INFO:teuthology.orchestra.run.smithi046:> sudo hostname smithi046 2019-12-24T23:04:55.623 INFO:teuthology.provision.fog.smithi046:Deploy complete! 2019-12-24T23:04:55.625 DEBUG:teuthology.parallel:result is None 2019-12-24T23:05:03.357 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi130.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T23:05:03.555 INFO:teuthology.orchestra.run.smithi130:> hostname 2019-12-24T23:05:04.101 INFO:teuthology.orchestra.run.smithi130.stdout:smithi130 2019-12-24T23:05:04.102 INFO:teuthology.orchestra.run.smithi130:> grep smithi130 /etc/hosts 2019-12-24T23:05:04.188 INFO:teuthology.orchestra.run.smithi130.stdout:172.21.15.130 smithi130.front.sepia.ceph.com smithi130 2019-12-24T23:05:04.188 INFO:teuthology.orchestra.run.smithi130:> sudo hostname smithi130 2019-12-24T23:05:04.347 INFO:teuthology.orchestra.run.smithi130:> sudo sed -i -e 's/smithi130/smithi130/g' /etc/hosts 2019-12-24T23:05:04.456 INFO:teuthology.orchestra.run.smithi130:> sudo sed -i -e 's/172.21.15.130/172.21.15.130/g' /etc/hosts 2019-12-24T23:05:04.543 INFO:teuthology.orchestra.run.smithi130:> sudo sed -i -e 's/smithi130/smithi130/g' /etc/hostname 2019-12-24T23:05:04.621 INFO:teuthology.orchestra.run.smithi130:> sudo hostname smithi130 2019-12-24T23:05:04.694 INFO:teuthology.provision.fog.smithi130:Deploy complete! 2019-12-24T23:05:04.696 DEBUG:teuthology.parallel:result is None 2019-12-24T23:05:27.439 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi152.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T23:05:27.659 INFO:teuthology.orchestra.run.smithi152:> hostname 2019-12-24T23:05:28.239 INFO:teuthology.orchestra.run.smithi152.stdout:smithi152 2019-12-24T23:05:28.240 INFO:teuthology.orchestra.run.smithi152:> grep smithi152 /etc/hosts 2019-12-24T23:05:28.328 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152 smithi152.front.sepia.ceph.com smithi152 2019-12-24T23:05:28.328 INFO:teuthology.orchestra.run.smithi152:> sudo hostname smithi152 2019-12-24T23:05:28.498 INFO:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/smithi152/smithi152/g' /etc/hosts 2019-12-24T23:05:28.612 INFO:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/172.21.15.152/172.21.15.152/g' /etc/hosts 2019-12-24T23:05:28.702 INFO:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/smithi152/smithi152/g' /etc/hostname 2019-12-24T23:05:28.775 INFO:teuthology.orchestra.run.smithi152:> sudo hostname smithi152 2019-12-24T23:05:28.842 INFO:teuthology.provision.fog.smithi152:Deploy complete! 2019-12-24T23:05:28.844 DEBUG:teuthology.parallel:result is None 2019-12-24T23:05:29.093 INFO:teuthology.lock.ops:Checking smithi046.front.sepia.ceph.com 2019-12-24T23:05:29.094 INFO:teuthology.lock.ops:New key found. Updating... 2019-12-24T23:05:29.109 INFO:teuthology.lock.ops:Checking smithi152.front.sepia.ceph.com 2019-12-24T23:05:29.110 INFO:teuthology.lock.ops:New key found. Updating... 2019-12-24T23:05:29.122 INFO:teuthology.lock.ops:Checking smithi130.front.sepia.ceph.com 2019-12-24T23:05:29.123 INFO:teuthology.lock.ops:New key found. Updating... 2019-12-24T23:05:29.145 INFO:teuthology.lock.ops:Updating [smithi046.front.sepia.ceph.com]: set os type and version on server 2019-12-24T23:05:29.145 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-24T23:05:29.146 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi046.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T23:05:29.245 INFO:teuthology.orchestra.run.smithi046:> true 2019-12-24T23:05:29.654 INFO:teuthology.orchestra.run.smithi046:> uname -m 2019-12-24T23:05:29.730 INFO:teuthology.orchestra.run.smithi046.stdout:x86_64 2019-12-24T23:05:29.731 INFO:teuthology.orchestra.run.smithi046:> cat /etc/os-release 2019-12-24T23:05:29.801 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="CentOS Linux" 2019-12-24T23:05:29.802 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="7 (Core)" 2019-12-24T23:05:29.802 INFO:teuthology.orchestra.run.smithi046.stdout:ID="centos" 2019-12-24T23:05:29.802 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE="rhel fedora" 2019-12-24T23:05:29.802 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="7" 2019-12-24T23:05:29.802 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2019-12-24T23:05:29.802 INFO:teuthology.orchestra.run.smithi046.stdout:ANSI_COLOR="0;31" 2019-12-24T23:05:29.803 INFO:teuthology.orchestra.run.smithi046.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2019-12-24T23:05:29.803 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://www.centos.org/" 2019-12-24T23:05:29.803 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2019-12-24T23:05:29.803 INFO:teuthology.orchestra.run.smithi046.stdout: 2019-12-24T23:05:29.803 INFO:teuthology.orchestra.run.smithi046.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2019-12-24T23:05:29.803 INFO:teuthology.orchestra.run.smithi046.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2019-12-24T23:05:29.804 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2019-12-24T23:05:29.804 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2019-12-24T23:05:29.804 INFO:teuthology.orchestra.run.smithi046.stdout: 2019-12-24T23:05:29.805 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server 2019-12-24T23:05:29.818 INFO:teuthology.lock.ops:Updating [smithi152.front.sepia.ceph.com]: set os type and version on server 2019-12-24T23:05:29.819 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-24T23:05:29.820 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi152.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T23:05:29.933 INFO:teuthology.orchestra.run.smithi152:> true 2019-12-24T23:05:30.312 INFO:teuthology.orchestra.run.smithi152:> uname -m 2019-12-24T23:05:30.400 INFO:teuthology.orchestra.run.smithi152.stdout:x86_64 2019-12-24T23:05:30.400 INFO:teuthology.orchestra.run.smithi152:> cat /etc/os-release 2019-12-24T23:05:30.468 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="CentOS Linux" 2019-12-24T23:05:30.468 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="7 (Core)" 2019-12-24T23:05:30.468 INFO:teuthology.orchestra.run.smithi152.stdout:ID="centos" 2019-12-24T23:05:30.468 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="rhel fedora" 2019-12-24T23:05:30.468 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="7" 2019-12-24T23:05:30.469 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2019-12-24T23:05:30.469 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31" 2019-12-24T23:05:30.469 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2019-12-24T23:05:30.469 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://www.centos.org/" 2019-12-24T23:05:30.469 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2019-12-24T23:05:30.469 INFO:teuthology.orchestra.run.smithi152.stdout: 2019-12-24T23:05:30.469 INFO:teuthology.orchestra.run.smithi152.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2019-12-24T23:05:30.470 INFO:teuthology.orchestra.run.smithi152.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2019-12-24T23:05:30.470 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2019-12-24T23:05:30.470 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2019-12-24T23:05:30.470 INFO:teuthology.orchestra.run.smithi152.stdout: 2019-12-24T23:05:30.471 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2019-12-24T23:05:30.486 INFO:teuthology.lock.ops:Updating [smithi130.front.sepia.ceph.com]: set os type and version on server 2019-12-24T23:05:30.487 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-24T23:05:30.487 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi130.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T23:05:30.584 INFO:teuthology.orchestra.run.smithi130:> true 2019-12-24T23:05:30.987 INFO:teuthology.orchestra.run.smithi130:> uname -m 2019-12-24T23:05:31.061 INFO:teuthology.orchestra.run.smithi130.stdout:x86_64 2019-12-24T23:05:31.062 INFO:teuthology.orchestra.run.smithi130:> cat /etc/os-release 2019-12-24T23:05:31.128 INFO:teuthology.orchestra.run.smithi130.stdout:NAME="CentOS Linux" 2019-12-24T23:05:31.128 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION="7 (Core)" 2019-12-24T23:05:31.129 INFO:teuthology.orchestra.run.smithi130.stdout:ID="centos" 2019-12-24T23:05:31.129 INFO:teuthology.orchestra.run.smithi130.stdout:ID_LIKE="rhel fedora" 2019-12-24T23:05:31.129 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION_ID="7" 2019-12-24T23:05:31.129 INFO:teuthology.orchestra.run.smithi130.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2019-12-24T23:05:31.129 INFO:teuthology.orchestra.run.smithi130.stdout:ANSI_COLOR="0;31" 2019-12-24T23:05:31.129 INFO:teuthology.orchestra.run.smithi130.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2019-12-24T23:05:31.129 INFO:teuthology.orchestra.run.smithi130.stdout:HOME_URL="https://www.centos.org/" 2019-12-24T23:05:31.130 INFO:teuthology.orchestra.run.smithi130.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2019-12-24T23:05:31.130 INFO:teuthology.orchestra.run.smithi130.stdout: 2019-12-24T23:05:31.130 INFO:teuthology.orchestra.run.smithi130.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2019-12-24T23:05:31.130 INFO:teuthology.orchestra.run.smithi130.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2019-12-24T23:05:31.130 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2019-12-24T23:05:31.130 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2019-12-24T23:05:31.130 INFO:teuthology.orchestra.run.smithi130.stdout: 2019-12-24T23:05:31.131 INFO:teuthology.lock.ops:Updating smithi130.front.sepia.ceph.com on lock server 2019-12-24T23:05:31.145 INFO:teuthology.task.internal.lock_machines:3 smithi machines locked this try, 3/3 locked so far 2019-12-24T23:05:31.188 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi046.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDtYQxdg2TSWE4CouTV8fbor/YxnFLvhLLNFd4me6d4uB+vpci9eGVYr8ncX0ZgmmozgkRDRbVBjyNC1c6hNIErw4o7SvLsRIixhqoAvvKVsH+GgpJxWpYwBbwnlxXeUmE6qfhGBIIyK3mYnFrMQhMQCFzieulLZa4/asesGjV+nr2mGJqDpweqT+K3Na0p5s9sCOnJYN2Dnl3YvcqTwy0zKjjq8M+CSRjwiNFuPO7owTJDpVQMVGuVcqCz14+lS0gBylymC5ktmsbCuMrxn+0vHt1znJjkSzoz8iaD1lpgXI1TrqDfnOrzHyp+lOQGX37xFFzOcyMoRIOKPmkQo3hP smithi130.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKW6a6zPsXBwDpdnGbl4UDypf4J1K0DLW9Tu9KOCJegeVJ9mbSbPq9KtCn7+4ASp6GtASAUZaPJq4KjVsDQPQqNilXXy8mBapBMGhn2mp4JXMkrqDjP9HNXSSE5o380ga3mVcQok9RUFib3UY6qJU6XHdCjR7J0FYQvgTgo9/H5xHdGyqlM8RTE4aniQ8Dv6JHK0lZE2IXYgYgFbjaHUN45mBKFVxslreR+B8vqeT0ZuEKtj9Ek5+l6JkUF1MA3uKqlFPMegjonOeoDlviFgGTW6JT8ua3jBmzkXPAoY3vi06uXl7gHF9H2AcbkNkuX4alu2/KIJ4Wq/PNqqpghspb smithi152.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFwVYRbIUUykgquX4lQHBpICbUzaJlOz7wZrInqKxLmw/knpHPcAlxva2IXqCKCX/LbT9I3Nyw1T60nMfIw2lxFVtfO9gQGKJcDBh5HdufIZ8260c2lXijWodK+3vZS/sWc+JhjXhG4ddBw5yKaVA69sfiK4wl+doT9iGiz7gQOV72KgFOHx+d4quq/XVwA2ZGgVisJqGLDqtcz5T9L2/0FPbZQ6day1XhJsHwgzCVe1WFU72d3Ewi+zuHEUf3ZD/KkrpATIrD7c4g4mBnfRX/7rOjKu7FNF+y21uz86VovbrGOuyYPz5GIb2H7h+0JmNir8Hx6tnf0Q3OcaC8Rg8h 2019-12-24T23:05:31.188 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2019-12-24T23:05:31.242 INFO:teuthology.run_tasks:Running task internal.save_config... 2019-12-24T23:05:31.251 INFO:teuthology.task.internal:Saving configuration 2019-12-24T23:05:31.271 INFO:teuthology.run_tasks:Running task internal.check_lock... 2019-12-24T23:05:31.282 INFO:teuthology.task.internal.check_lock:Checking locks... 2019-12-24T23:05:31.296 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2019-12-24 23:00:13.986613', u'locked_by': u'scheduled_sage@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi046.front.sepia.ceph.com', u'os_version': u'7', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'centos', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG58fsrlxrvls6K5pCtr8jXt7xtdekbF0XD1qipIl8C5n8sLWFWR/KGnC+79Fcx0NaraCVPIfP4KXOGZOro7oGk=', u'description': u'/home/teuthworker/archive/sage-2019-12-24_21:11:08-rados:thrash-old-clients-wip-sage-testing-2019-12-23-1810-distro-basic-smithi/4630508'} 2019-12-24T23:05:31.308 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2019-12-24 23:00:13.986628', u'locked_by': u'scheduled_sage@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi130.front.sepia.ceph.com', u'os_version': u'7', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'centos', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPVCyoF4FdNT/vc2cewjz/q6swM2p11zxdXgk65n1XJ79XYomv78VovrpTFfh9AKu/UxDbz3QFRsADvpd1JkMXs=', u'description': u'/home/teuthworker/archive/sage-2019-12-24_21:11:08-rados:thrash-old-clients-wip-sage-testing-2019-12-23-1810-distro-basic-smithi/4630508'} 2019-12-24T23:05:31.321 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2019-12-24 23:00:13.986594', u'locked_by': u'scheduled_sage@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi152.front.sepia.ceph.com', u'os_version': u'7', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'centos', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGEIORN5Ek70DGCnxZk/EQpsG43ZZgDHR2UFLFqG4rxDMPDlyTtV4x7TQ6DfRebFjrz8o4FQ3t1hApsvB9CXyUc=', u'description': u'/home/teuthworker/archive/sage-2019-12-24_21:11:08-rados:thrash-old-clients-wip-sage-testing-2019-12-23-1810-distro-basic-smithi/4630508'} 2019-12-24T23:05:31.321 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2019-12-24T23:05:31.332 INFO:teuthology.task.internal:roles: ubuntu@smithi046.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2019-12-24T23:05:31.333 INFO:teuthology.task.internal:roles: ubuntu@smithi130.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2019-12-24T23:05:31.333 INFO:teuthology.task.internal:roles: ubuntu@smithi152.front.sepia.ceph.com - ['mon.c', 'osd.8', 'osd.9', 'osd.10', 'osd.11', 'client.2'] 2019-12-24T23:05:31.333 INFO:teuthology.run_tasks:Running task console_log... 2019-12-24T23:05:31.434 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2019-12-24T23:05:31.435 INFO:teuthology.run_tasks:Running task internal.connect... 2019-12-24T23:05:31.446 INFO:teuthology.task.internal:Opening connections... 2019-12-24T23:05:31.446 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi152.front.sepia.ceph.com 2019-12-24T23:05:31.448 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi152.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T23:05:31.554 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi046.front.sepia.ceph.com 2019-12-24T23:05:31.554 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi046.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T23:05:31.658 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi130.front.sepia.ceph.com 2019-12-24T23:05:31.659 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi130.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T23:05:31.761 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2019-12-24T23:05:31.908 INFO:teuthology.orchestra.run.smithi152:> uname -m 2019-12-24T23:05:32.028 INFO:teuthology.orchestra.run.smithi152.stdout:x86_64 2019-12-24T23:05:32.029 INFO:teuthology.orchestra.run.smithi152:> cat /etc/os-release 2019-12-24T23:05:32.102 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="CentOS Linux" 2019-12-24T23:05:32.102 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="7 (Core)" 2019-12-24T23:05:32.102 INFO:teuthology.orchestra.run.smithi152.stdout:ID="centos" 2019-12-24T23:05:32.103 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="rhel fedora" 2019-12-24T23:05:32.103 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="7" 2019-12-24T23:05:32.103 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2019-12-24T23:05:32.103 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31" 2019-12-24T23:05:32.103 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2019-12-24T23:05:32.103 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://www.centos.org/" 2019-12-24T23:05:32.103 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2019-12-24T23:05:32.104 INFO:teuthology.orchestra.run.smithi152.stdout: 2019-12-24T23:05:32.104 INFO:teuthology.orchestra.run.smithi152.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2019-12-24T23:05:32.104 INFO:teuthology.orchestra.run.smithi152.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2019-12-24T23:05:32.104 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2019-12-24T23:05:32.104 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2019-12-24T23:05:32.105 INFO:teuthology.orchestra.run.smithi152.stdout: 2019-12-24T23:05:32.105 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2019-12-24T23:05:32.120 INFO:teuthology.orchestra.run.smithi046:> uname -m 2019-12-24T23:05:32.244 INFO:teuthology.orchestra.run.smithi046.stdout:x86_64 2019-12-24T23:05:32.245 INFO:teuthology.orchestra.run.smithi046:> cat /etc/os-release 2019-12-24T23:05:32.314 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="CentOS Linux" 2019-12-24T23:05:32.314 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="7 (Core)" 2019-12-24T23:05:32.314 INFO:teuthology.orchestra.run.smithi046.stdout:ID="centos" 2019-12-24T23:05:32.314 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE="rhel fedora" 2019-12-24T23:05:32.315 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="7" 2019-12-24T23:05:32.315 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2019-12-24T23:05:32.315 INFO:teuthology.orchestra.run.smithi046.stdout:ANSI_COLOR="0;31" 2019-12-24T23:05:32.315 INFO:teuthology.orchestra.run.smithi046.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2019-12-24T23:05:32.315 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://www.centos.org/" 2019-12-24T23:05:32.316 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2019-12-24T23:05:32.316 INFO:teuthology.orchestra.run.smithi046.stdout: 2019-12-24T23:05:32.316 INFO:teuthology.orchestra.run.smithi046.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2019-12-24T23:05:32.316 INFO:teuthology.orchestra.run.smithi046.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2019-12-24T23:05:32.316 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2019-12-24T23:05:32.316 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2019-12-24T23:05:32.317 INFO:teuthology.orchestra.run.smithi046.stdout: 2019-12-24T23:05:32.317 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server 2019-12-24T23:05:32.336 INFO:teuthology.orchestra.run.smithi130:> uname -m 2019-12-24T23:05:32.459 INFO:teuthology.orchestra.run.smithi130.stdout:x86_64 2019-12-24T23:05:32.459 INFO:teuthology.orchestra.run.smithi130:> cat /etc/os-release 2019-12-24T23:05:32.541 INFO:teuthology.orchestra.run.smithi130.stdout:NAME="CentOS Linux" 2019-12-24T23:05:32.541 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION="7 (Core)" 2019-12-24T23:05:32.541 INFO:teuthology.orchestra.run.smithi130.stdout:ID="centos" 2019-12-24T23:05:32.541 INFO:teuthology.orchestra.run.smithi130.stdout:ID_LIKE="rhel fedora" 2019-12-24T23:05:32.542 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION_ID="7" 2019-12-24T23:05:32.542 INFO:teuthology.orchestra.run.smithi130.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2019-12-24T23:05:32.542 INFO:teuthology.orchestra.run.smithi130.stdout:ANSI_COLOR="0;31" 2019-12-24T23:05:32.542 INFO:teuthology.orchestra.run.smithi130.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2019-12-24T23:05:32.543 INFO:teuthology.orchestra.run.smithi130.stdout:HOME_URL="https://www.centos.org/" 2019-12-24T23:05:32.543 INFO:teuthology.orchestra.run.smithi130.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2019-12-24T23:05:32.543 INFO:teuthology.orchestra.run.smithi130.stdout: 2019-12-24T23:05:32.543 INFO:teuthology.orchestra.run.smithi130.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2019-12-24T23:05:32.543 INFO:teuthology.orchestra.run.smithi130.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2019-12-24T23:05:32.544 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2019-12-24T23:05:32.544 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2019-12-24T23:05:32.544 INFO:teuthology.orchestra.run.smithi130.stdout: 2019-12-24T23:05:32.544 INFO:teuthology.lock.ops:Updating smithi130.front.sepia.ceph.com on lock server 2019-12-24T23:05:32.556 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2019-12-24T23:05:32.627 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2019-12-24T23:05:32.643 INFO:teuthology.task.internal:Checking for old test directory... 2019-12-24T23:05:32.644 INFO:teuthology.orchestra.run.smithi046:> test '!' -e /home/ubuntu/cephtest 2019-12-24T23:05:32.648 INFO:teuthology.orchestra.run.smithi130:> test '!' -e /home/ubuntu/cephtest 2019-12-24T23:05:32.651 INFO:teuthology.orchestra.run.smithi152:> test '!' -e /home/ubuntu/cephtest 2019-12-24T23:05:32.737 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2019-12-24T23:05:32.757 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2019-12-24T23:05:32.758 INFO:teuthology.orchestra.run.smithi046:> test -z $(ls -A /var/lib/ceph) 2019-12-24T23:05:32.762 INFO:teuthology.orchestra.run.smithi130:> test -z $(ls -A /var/lib/ceph) 2019-12-24T23:05:32.766 INFO:teuthology.orchestra.run.smithi152:> test -z $(ls -A /var/lib/ceph) 2019-12-24T23:05:32.867 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2019-12-24T23:05:32.934 INFO:teuthology.run_tasks:Running task kernel... 2019-12-24T23:05:32.971 DEBUG:teuthology.task.kernel:normalized config {'osd.9': {'sha1': 'distro', 'kdb': True}, 'osd.8': {'sha1': 'distro', 'kdb': True}, 'mon.c': {'sha1': 'distro', 'kdb': True}, 'client.0': {'sha1': 'distro', 'kdb': True}, 'osd.1': {'sha1': 'distro', 'kdb': True}, 'client.2': {'sha1': 'distro', 'kdb': True}, 'osd.3': {'sha1': 'distro', 'kdb': True}, 'osd.2': {'sha1': 'distro', 'kdb': True}, 'osd.5': {'sha1': 'distro', 'kdb': True}, 'osd.4': {'sha1': 'distro', 'kdb': True}, 'osd.7': {'sha1': 'distro', 'kdb': True}, 'osd.6': {'sha1': 'distro', 'kdb': True}, 'osd.11': {'sha1': 'distro', 'kdb': True}, 'osd.10': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}, 'mgr.y': {'sha1': 'distro', 'kdb': True}, 'mgr.x': {'sha1': 'distro', 'kdb': True}, 'osd.0': {'sha1': 'distro', 'kdb': True}, 'mon.a': {'sha1': 'distro', 'kdb': True}, 'client.1': {'sha1': 'distro', 'kdb': True}} 2019-12-24T23:05:32.971 INFO:teuthology.task.kernel:config {'mon.c': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}, 'mon.a': {'sha1': 'distro', 'kdb': True}}, timeout 300 2019-12-24T23:05:32.971 INFO:teuthology.orchestra.run.smithi152:> uname -r 2019-12-24T23:05:33.062 INFO:teuthology.orchestra.run.smithi152.stdout:3.10.0-1062.4.1.el7.x86_64 2019-12-24T23:05:33.063 INFO:teuthology.task.kernel:Running kernel on smithi152: 3.10.0-1062.4.1.el7.x86_64 2019-12-24T23:05:33.063 INFO:teuthology.orchestra.run.smithi152:> sudo yum install -y kernel 2019-12-24T23:05:33.912 INFO:teuthology.orchestra.run.smithi152.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T23:05:34.048 INFO:teuthology.orchestra.run.smithi152.stdout:Determining fastest mirrors 2019-12-24T23:05:37.545 INFO:teuthology.orchestra.run.smithi152.stdout: * base: mirror.linux.duke.edu 2019-12-24T23:05:37.546 INFO:teuthology.orchestra.run.smithi152.stdout: * epel: ftp.linux.ncsu.edu 2019-12-24T23:05:37.547 INFO:teuthology.orchestra.run.smithi152.stdout: * extras: www.gtlib.gatech.edu 2019-12-24T23:05:37.548 INFO:teuthology.orchestra.run.smithi152.stdout: * updates: mirror.vtti.vt.edu 2019-12-24T23:05:40.434 INFO:teuthology.orchestra.run.smithi152.stdout:Resolving Dependencies 2019-12-24T23:05:40.434 INFO:teuthology.orchestra.run.smithi152.stdout:--> Running transaction check 2019-12-24T23:05:40.435 INFO:teuthology.orchestra.run.smithi152.stdout:---> Package kernel.x86_64 0:3.10.0-1062.9.1.el7 will be installed 2019-12-24T23:05:41.769 INFO:teuthology.orchestra.run.smithi152.stdout:--> Finished Dependency Resolution 2019-12-24T23:05:42.769 INFO:teuthology.orchestra.run.smithi152.stdout: 2019-12-24T23:05:42.769 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies Resolved 2019-12-24T23:05:42.780 INFO:teuthology.orchestra.run.smithi152.stdout: 2019-12-24T23:05:42.780 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2019-12-24T23:05:42.780 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2019-12-24T23:05:42.780 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2019-12-24T23:05:42.780 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2019-12-24T23:05:42.781 INFO:teuthology.orchestra.run.smithi152.stdout: kernel x86_64 3.10.0-1062.9.1.el7 updates 50 M 2019-12-24T23:05:42.781 INFO:teuthology.orchestra.run.smithi152.stdout: 2019-12-24T23:05:42.781 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2019-12-24T23:05:42.781 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2019-12-24T23:05:42.781 INFO:teuthology.orchestra.run.smithi152.stdout:Install 1 Package 2019-12-24T23:05:42.781 INFO:teuthology.orchestra.run.smithi152.stdout: 2019-12-24T23:05:42.782 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 50 M 2019-12-24T23:05:42.782 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 64 M 2019-12-24T23:05:42.782 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading packages: 2019-12-24T23:05:42.791 INFO:teuthology.orchestra.run.smithi152.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-12-24T23:05:44.053 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2019-12-24T23:05:44.247 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2019-12-24T23:05:45.097 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded 2019-12-24T23:05:45.098 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2019-12-24T23:06:20.092 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : kernel-3.10.0-1062.9.1.el7.x86_64 1/1 2019-12-24T23:06:20.622 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : kernel-3.10.0-1062.9.1.el7.x86_64 1/1 2019-12-24T23:06:20.623 INFO:teuthology.orchestra.run.smithi152.stdout: 2019-12-24T23:06:20.623 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2019-12-24T23:06:20.623 INFO:teuthology.orchestra.run.smithi152.stdout: kernel.x86_64 0:3.10.0-1062.9.1.el7 2019-12-24T23:06:20.623 INFO:teuthology.orchestra.run.smithi152.stdout: 2019-12-24T23:06:20.623 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2019-12-24T23:06:20.674 INFO:teuthology.orchestra.run.smithi152:> rpm -q kernel --last | head -n 1 2019-12-24T23:06:21.071 INFO:teuthology.orchestra.run.smithi152.stdout:kernel-3.10.0-1062.9.1.el7.x86_64 Tue 24 Dec 2019 11:05:47 PM UTC 2019-12-24T23:06:21.073 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.9.1.el7.x86_64 2019-12-24T23:06:21.073 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 3.10.0-1062.4.1.el7.x86_64 Expected: 3.10.0-1062.9.1.el7.x86_64 2019-12-24T23:06:21.074 INFO:teuthology.orchestra.run.smithi130:> uname -r 2019-12-24T23:06:21.164 INFO:teuthology.orchestra.run.smithi130.stdout:3.10.0-1062.4.1.el7.x86_64 2019-12-24T23:06:21.165 INFO:teuthology.task.kernel:Running kernel on smithi130: 3.10.0-1062.4.1.el7.x86_64 2019-12-24T23:06:21.165 INFO:teuthology.orchestra.run.smithi130:> sudo yum install -y kernel 2019-12-24T23:06:22.044 INFO:teuthology.orchestra.run.smithi130.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T23:06:22.171 INFO:teuthology.orchestra.run.smithi130.stdout:Determining fastest mirrors 2019-12-24T23:06:22.871 INFO:teuthology.orchestra.run.smithi130.stdout: * base: mirror.linux.duke.edu 2019-12-24T23:06:22.881 INFO:teuthology.orchestra.run.smithi130.stdout: * epel: ftp.linux.ncsu.edu 2019-12-24T23:06:22.881 INFO:teuthology.orchestra.run.smithi130.stdout: * extras: www.gtlib.gatech.edu 2019-12-24T23:06:22.882 INFO:teuthology.orchestra.run.smithi130.stdout: * updates: mirror.vtti.vt.edu 2019-12-24T23:06:25.983 INFO:teuthology.orchestra.run.smithi130.stdout:Resolving Dependencies 2019-12-24T23:06:25.983 INFO:teuthology.orchestra.run.smithi130.stdout:--> Running transaction check 2019-12-24T23:06:25.984 INFO:teuthology.orchestra.run.smithi130.stdout:---> Package kernel.x86_64 0:3.10.0-1062.9.1.el7 will be installed 2019-12-24T23:06:27.366 INFO:teuthology.orchestra.run.smithi130.stdout:--> Finished Dependency Resolution 2019-12-24T23:06:28.196 INFO:teuthology.orchestra.run.smithi130.stdout: 2019-12-24T23:06:28.196 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies Resolved 2019-12-24T23:06:28.208 INFO:teuthology.orchestra.run.smithi130.stdout: 2019-12-24T23:06:28.208 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2019-12-24T23:06:28.209 INFO:teuthology.orchestra.run.smithi130.stdout: Package Arch Version Repository Size 2019-12-24T23:06:28.209 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2019-12-24T23:06:28.209 INFO:teuthology.orchestra.run.smithi130.stdout:Installing: 2019-12-24T23:06:28.209 INFO:teuthology.orchestra.run.smithi130.stdout: kernel x86_64 3.10.0-1062.9.1.el7 updates 50 M 2019-12-24T23:06:28.209 INFO:teuthology.orchestra.run.smithi130.stdout: 2019-12-24T23:06:28.209 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction Summary 2019-12-24T23:06:28.209 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2019-12-24T23:06:28.210 INFO:teuthology.orchestra.run.smithi130.stdout:Install 1 Package 2019-12-24T23:06:28.210 INFO:teuthology.orchestra.run.smithi130.stdout: 2019-12-24T23:06:28.210 INFO:teuthology.orchestra.run.smithi130.stdout:Total download size: 50 M 2019-12-24T23:06:28.210 INFO:teuthology.orchestra.run.smithi130.stdout:Installed size: 64 M 2019-12-24T23:06:28.210 INFO:teuthology.orchestra.run.smithi130.stdout:Downloading packages: 2019-12-24T23:06:28.213 INFO:teuthology.orchestra.run.smithi130.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-12-24T23:06:29.194 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction check 2019-12-24T23:06:29.389 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction test 2019-12-24T23:06:30.283 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction test succeeded 2019-12-24T23:06:30.284 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction 2019-12-24T23:07:05.065 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : kernel-3.10.0-1062.9.1.el7.x86_64 1/1 2019-12-24T23:07:05.929 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : kernel-3.10.0-1062.9.1.el7.x86_64 1/1 2019-12-24T23:07:05.929 INFO:teuthology.orchestra.run.smithi130.stdout: 2019-12-24T23:07:05.929 INFO:teuthology.orchestra.run.smithi130.stdout:Installed: 2019-12-24T23:07:05.929 INFO:teuthology.orchestra.run.smithi130.stdout: kernel.x86_64 0:3.10.0-1062.9.1.el7 2019-12-24T23:07:05.930 INFO:teuthology.orchestra.run.smithi130.stdout: 2019-12-24T23:07:05.930 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2019-12-24T23:07:05.979 INFO:teuthology.orchestra.run.smithi130:> rpm -q kernel --last | head -n 1 2019-12-24T23:07:06.372 INFO:teuthology.orchestra.run.smithi130.stdout:kernel-3.10.0-1062.9.1.el7.x86_64 Tue 24 Dec 2019 11:06:33 PM UTC 2019-12-24T23:07:06.376 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.9.1.el7.x86_64 2019-12-24T23:07:06.376 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 3.10.0-1062.4.1.el7.x86_64 Expected: 3.10.0-1062.9.1.el7.x86_64 2019-12-24T23:07:06.376 INFO:teuthology.orchestra.run.smithi046:> uname -r 2019-12-24T23:07:06.479 INFO:teuthology.orchestra.run.smithi046.stdout:3.10.0-1062.4.1.el7.x86_64 2019-12-24T23:07:06.479 INFO:teuthology.task.kernel:Running kernel on smithi046: 3.10.0-1062.4.1.el7.x86_64 2019-12-24T23:07:06.479 INFO:teuthology.orchestra.run.smithi046:> sudo yum install -y kernel 2019-12-24T23:07:07.436 INFO:teuthology.orchestra.run.smithi046.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-24T23:07:07.557 INFO:teuthology.orchestra.run.smithi046.stdout:Determining fastest mirrors 2019-12-24T23:07:08.345 INFO:teuthology.orchestra.run.smithi046.stdout: * base: mirror.linux.duke.edu 2019-12-24T23:07:08.356 INFO:teuthology.orchestra.run.smithi046.stdout: * epel: ftp.linux.ncsu.edu 2019-12-24T23:07:08.357 INFO:teuthology.orchestra.run.smithi046.stdout: * extras: www.gtlib.gatech.edu 2019-12-24T23:07:08.357 INFO:teuthology.orchestra.run.smithi046.stdout: * updates: mirror.vtti.vt.edu 2019-12-24T23:07:11.424 INFO:teuthology.orchestra.run.smithi046.stdout:Resolving Dependencies 2019-12-24T23:07:11.424 INFO:teuthology.orchestra.run.smithi046.stdout:--> Running transaction check 2019-12-24T23:07:11.424 INFO:teuthology.orchestra.run.smithi046.stdout:---> Package kernel.x86_64 0:3.10.0-1062.9.1.el7 will be installed 2019-12-24T23:07:12.751 INFO:teuthology.orchestra.run.smithi046.stdout:--> Finished Dependency Resolution 2019-12-24T23:07:13.578 INFO:teuthology.orchestra.run.smithi046.stdout: 2019-12-24T23:07:13.578 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies Resolved 2019-12-24T23:07:13.587 INFO:teuthology.orchestra.run.smithi046.stdout: 2019-12-24T23:07:13.587 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2019-12-24T23:07:13.587 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2019-12-24T23:07:13.588 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2019-12-24T23:07:13.588 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2019-12-24T23:07:13.588 INFO:teuthology.orchestra.run.smithi046.stdout: kernel x86_64 3.10.0-1062.9.1.el7 updates 50 M 2019-12-24T23:07:13.588 INFO:teuthology.orchestra.run.smithi046.stdout: 2019-12-24T23:07:13.588 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2019-12-24T23:07:13.588 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2019-12-24T23:07:13.588 INFO:teuthology.orchestra.run.smithi046.stdout:Install 1 Package 2019-12-24T23:07:13.589 INFO:teuthology.orchestra.run.smithi046.stdout: 2019-12-24T23:07:13.589 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 50 M 2019-12-24T23:07:13.589 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 64 M 2019-12-24T23:07:13.589 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading packages: 2019-12-24T23:07:13.597 INFO:teuthology.orchestra.run.smithi046.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-12-24T23:07:14.581 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2019-12-24T23:07:14.778 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2019-12-24T23:07:15.542 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded 2019-12-24T23:07:15.542 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2019-12-24T23:07:53.041 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : kernel-3.10.0-1062.9.1.el7.x86_64 1/1 2019-12-24T23:07:53.552 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : kernel-3.10.0-1062.9.1.el7.x86_64 1/1 2019-12-24T23:07:53.553 INFO:teuthology.orchestra.run.smithi046.stdout: 2019-12-24T23:07:53.553 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2019-12-24T23:07:53.553 INFO:teuthology.orchestra.run.smithi046.stdout: kernel.x86_64 0:3.10.0-1062.9.1.el7 2019-12-24T23:07:53.554 INFO:teuthology.orchestra.run.smithi046.stdout: 2019-12-24T23:07:53.554 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2019-12-24T23:07:53.619 INFO:teuthology.orchestra.run.smithi046:> rpm -q kernel --last | head -n 1 2019-12-24T23:07:54.044 INFO:teuthology.orchestra.run.smithi046.stdout:kernel-3.10.0-1062.9.1.el7.x86_64 Tue 24 Dec 2019 11:07:18 PM UTC 2019-12-24T23:07:54.047 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.9.1.el7.x86_64 2019-12-24T23:07:54.047 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 3.10.0-1062.4.1.el7.x86_64 Expected: 3.10.0-1062.9.1.el7.x86_64 2019-12-24T23:07:54.048 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2019-12-24T23:07:54.048 DEBUG:teuthology.task.kernel:src is distro, skipping download 2019-12-24T23:07:54.048 DEBUG:teuthology.task.kernel:src is distro, skipping download 2019-12-24T23:07:54.048 DEBUG:teuthology.task.kernel:src is distro, skipping download 2019-12-24T23:07:54.048 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2019-12-24T23:07:54.048 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi046.front.sepia.ceph.com, path=None, version=distro) 2019-12-24T23:07:54.048 INFO:teuthology.orchestra.run.smithi046:> rpm -q kernel --last | head -n 1 2019-12-24T23:07:54.352 INFO:teuthology.orchestra.run.smithi046.stdout:kernel-3.10.0-1062.9.1.el7.x86_64 Tue 24 Dec 2019 11:07:18 PM UTC 2019-12-24T23:07:54.356 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.9.1.el7.x86_64 2019-12-24T23:07:54.356 INFO:teuthology.orchestra.run.smithi046:> sudo rpm -qi grub2-tools 2019-12-24T23:07:54.519 INFO:teuthology.orchestra.run.smithi046.stdout:Name : grub2-tools 2019-12-24T23:07:54.520 INFO:teuthology.orchestra.run.smithi046.stdout:Epoch : 1 2019-12-24T23:07:54.520 INFO:teuthology.orchestra.run.smithi046.stdout:Version : 2.02 2019-12-24T23:07:54.520 INFO:teuthology.orchestra.run.smithi046.stdout:Release : 0.76.el7.centos 2019-12-24T23:07:54.520 INFO:teuthology.orchestra.run.smithi046.stdout:Architecture: x86_64 2019-12-24T23:07:54.520 INFO:teuthology.orchestra.run.smithi046.stdout:Install Date: Tue 05 Nov 2019 03:40:24 PM UTC 2019-12-24T23:07:54.520 INFO:teuthology.orchestra.run.smithi046.stdout:Group : System Environment/Base 2019-12-24T23:07:54.521 INFO:teuthology.orchestra.run.smithi046.stdout:Size : 10080361 2019-12-24T23:07:54.521 INFO:teuthology.orchestra.run.smithi046.stdout:License : GPLv3+ 2019-12-24T23:07:54.521 INFO:teuthology.orchestra.run.smithi046.stdout:Signature : RSA/SHA256, Mon 12 Nov 2018 02:28:11 PM UTC, Key ID 24c6a8a7f4a80eb5 2019-12-24T23:07:54.521 INFO:teuthology.orchestra.run.smithi046.stdout:Source RPM : grub2-2.02-0.76.el7.centos.src.rpm 2019-12-24T23:07:54.521 INFO:teuthology.orchestra.run.smithi046.stdout:Build Date : Fri 09 Nov 2018 12:58:43 AM UTC 2019-12-24T23:07:54.521 INFO:teuthology.orchestra.run.smithi046.stdout:Build Host : kbuilder.bsys.centos.org 2019-12-24T23:07:54.521 INFO:teuthology.orchestra.run.smithi046.stdout:Relocations : (not relocatable) 2019-12-24T23:07:54.522 INFO:teuthology.orchestra.run.smithi046.stdout:Packager : CentOS BuildSystem 2019-12-24T23:07:54.522 INFO:teuthology.orchestra.run.smithi046.stdout:Vendor : CentOS 2019-12-24T23:07:54.522 INFO:teuthology.orchestra.run.smithi046.stdout:URL : http://www.gnu.org/software/grub/ 2019-12-24T23:07:54.522 INFO:teuthology.orchestra.run.smithi046.stdout:Summary : Support tools for GRUB. 2019-12-24T23:07:54.522 INFO:teuthology.orchestra.run.smithi046.stdout:Description : 2019-12-24T23:07:54.522 INFO:teuthology.orchestra.run.smithi046.stdout: 2019-12-24T23:07:54.522 INFO:teuthology.orchestra.run.smithi046.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2019-12-24T23:07:54.522 INFO:teuthology.orchestra.run.smithi046.stdout:customizable bootloader with modular architecture. It supports a rich 2019-12-24T23:07:54.523 INFO:teuthology.orchestra.run.smithi046.stdout:variety of kernel formats, file systems, computer architectures and 2019-12-24T23:07:54.523 INFO:teuthology.orchestra.run.smithi046.stdout:hardware devices. 2019-12-24T23:07:54.523 INFO:teuthology.orchestra.run.smithi046.stdout: 2019-12-24T23:07:54.523 INFO:teuthology.orchestra.run.smithi046.stdout:This subpackage provides tools for support of all platforms. 2019-12-24T23:07:54.524 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2019-12-24T23:07:54.524 INFO:teuthology.task.kernel:Updating grub on smithi046 to boot 3.10.0-1062.9.1.el7.x86_64 2019-12-24T23:07:54.524 INFO:teuthology.orchestra.run.smithi046:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2019-12-24T23:07:55.026 INFO:teuthology.orchestra.run.smithi046.stderr:Generating grub configuration file ... 2019-12-24T23:07:55.164 INFO:teuthology.orchestra.run.smithi046.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.9.1.el7.x86_64 2019-12-24T23:07:55.180 INFO:teuthology.orchestra.run.smithi046.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.9.1.el7.x86_64.img 2019-12-24T23:07:55.488 INFO:teuthology.orchestra.run.smithi046.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.4.1.el7.x86_64 2019-12-24T23:07:55.523 INFO:teuthology.orchestra.run.smithi046.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.4.1.el7.x86_64.img 2019-12-24T23:07:55.569 INFO:teuthology.orchestra.run.smithi046.stderr:Found linux image: /boot/vmlinuz-3.10.0-957.el7.x86_64 2019-12-24T23:07:55.603 INFO:teuthology.orchestra.run.smithi046.stderr:Found initrd image: /boot/initramfs-3.10.0-957.el7.x86_64.img 2019-12-24T23:07:55.640 INFO:teuthology.orchestra.run.smithi046.stderr:Found linux image: /boot/vmlinuz-0-rescue-a1739c9c60b14f0891126d2e603bb003 2019-12-24T23:07:55.653 INFO:teuthology.orchestra.run.smithi046.stderr:Found initrd image: /boot/initramfs-0-rescue-a1739c9c60b14f0891126d2e603bb003.img 2019-12-24T23:07:56.856 INFO:teuthology.orchestra.run.smithi046.stderr:done 2019-12-24T23:07:56.858 INFO:teuthology.orchestra.run.smithi046:> mktemp 2019-12-24T23:07:56.926 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/tmp.JqtZRYm3J6 2019-12-24T23:07:56.926 INFO:teuthology.orchestra.run.smithi046:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.JqtZRYm3J6 2019-12-24T23:07:57.005 INFO:teuthology.orchestra.run.smithi046:> sudo chmod 0666 /tmp/tmp.JqtZRYm3J6 2019-12-24T23:07:57.137 DEBUG:teuthology.orchestra.remote:smithi046:/tmp/tmp.JqtZRYm3J6 is 6KB 2019-12-24T23:07:57.195 INFO:teuthology.orchestra.run.smithi046:> rm -fr /tmp/tmp.JqtZRYm3J6 2019-12-24T23:07:57.266 INFO:teuthology.orchestra.run.smithi046:> sudo grub2-set-default 0 2019-12-24T23:07:57.468 INFO:teuthology.orchestra.run.smithi046:> sudo shutdown -r now 2019-12-24T23:07:57.472 INFO:teuthology.task.kernel:Installing distro kernel on mon.c... 2019-12-24T23:07:57.472 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi152.front.sepia.ceph.com, path=None, version=distro) 2019-12-24T23:07:57.472 INFO:teuthology.orchestra.run.smithi152:> rpm -q kernel --last | head -n 1 2019-12-24T23:07:57.845 INFO:teuthology.orchestra.run.smithi152.stdout:kernel-3.10.0-1062.9.1.el7.x86_64 Tue 24 Dec 2019 11:05:47 PM UTC 2019-12-24T23:07:57.847 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.9.1.el7.x86_64 2019-12-24T23:07:57.847 INFO:teuthology.orchestra.run.smithi152:> sudo rpm -qi grub2-tools 2019-12-24T23:07:58.014 INFO:teuthology.orchestra.run.smithi152.stdout:Name : grub2-tools 2019-12-24T23:07:58.015 INFO:teuthology.orchestra.run.smithi152.stdout:Epoch : 1 2019-12-24T23:07:58.015 INFO:teuthology.orchestra.run.smithi152.stdout:Version : 2.02 2019-12-24T23:07:58.015 INFO:teuthology.orchestra.run.smithi152.stdout:Release : 0.76.el7.centos 2019-12-24T23:07:58.015 INFO:teuthology.orchestra.run.smithi152.stdout:Architecture: x86_64 2019-12-24T23:07:58.015 INFO:teuthology.orchestra.run.smithi152.stdout:Install Date: Tue 05 Nov 2019 03:40:24 PM UTC 2019-12-24T23:07:58.015 INFO:teuthology.orchestra.run.smithi152.stdout:Group : System Environment/Base 2019-12-24T23:07:58.015 INFO:teuthology.orchestra.run.smithi152.stdout:Size : 10080361 2019-12-24T23:07:58.016 INFO:teuthology.orchestra.run.smithi152.stdout:License : GPLv3+ 2019-12-24T23:07:58.016 INFO:teuthology.orchestra.run.smithi152.stdout:Signature : RSA/SHA256, Mon 12 Nov 2018 02:28:11 PM UTC, Key ID 24c6a8a7f4a80eb5 2019-12-24T23:07:58.016 INFO:teuthology.orchestra.run.smithi152.stdout:Source RPM : grub2-2.02-0.76.el7.centos.src.rpm 2019-12-24T23:07:58.016 INFO:teuthology.orchestra.run.smithi152.stdout:Build Date : Fri 09 Nov 2018 12:58:43 AM UTC 2019-12-24T23:07:58.016 INFO:teuthology.orchestra.run.smithi152.stdout:Build Host : kbuilder.bsys.centos.org 2019-12-24T23:07:58.016 INFO:teuthology.orchestra.run.smithi152.stdout:Relocations : (not relocatable) 2019-12-24T23:07:58.016 INFO:teuthology.orchestra.run.smithi152.stdout:Packager : CentOS BuildSystem 2019-12-24T23:07:58.017 INFO:teuthology.orchestra.run.smithi152.stdout:Vendor : CentOS 2019-12-24T23:07:58.017 INFO:teuthology.orchestra.run.smithi152.stdout:URL : http://www.gnu.org/software/grub/ 2019-12-24T23:07:58.017 INFO:teuthology.orchestra.run.smithi152.stdout:Summary : Support tools for GRUB. 2019-12-24T23:07:58.017 INFO:teuthology.orchestra.run.smithi152.stdout:Description : 2019-12-24T23:07:58.017 INFO:teuthology.orchestra.run.smithi152.stdout: 2019-12-24T23:07:58.017 INFO:teuthology.orchestra.run.smithi152.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2019-12-24T23:07:58.017 INFO:teuthology.orchestra.run.smithi152.stdout:customizable bootloader with modular architecture. It supports a rich 2019-12-24T23:07:58.018 INFO:teuthology.orchestra.run.smithi152.stdout:variety of kernel formats, file systems, computer architectures and 2019-12-24T23:07:58.018 INFO:teuthology.orchestra.run.smithi152.stdout:hardware devices. 2019-12-24T23:07:58.018 INFO:teuthology.orchestra.run.smithi152.stdout: 2019-12-24T23:07:58.018 INFO:teuthology.orchestra.run.smithi152.stdout:This subpackage provides tools for support of all platforms. 2019-12-24T23:07:58.019 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2019-12-24T23:07:58.019 INFO:teuthology.task.kernel:Updating grub on smithi152 to boot 3.10.0-1062.9.1.el7.x86_64 2019-12-24T23:07:58.019 INFO:teuthology.orchestra.run.smithi152:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2019-12-24T23:07:58.501 INFO:teuthology.orchestra.run.smithi152.stderr:Generating grub configuration file ... 2019-12-24T23:07:58.630 INFO:teuthology.orchestra.run.smithi152.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.9.1.el7.x86_64 2019-12-24T23:07:58.646 INFO:teuthology.orchestra.run.smithi152.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.9.1.el7.x86_64.img 2019-12-24T23:07:58.886 INFO:teuthology.orchestra.run.smithi152.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.4.1.el7.x86_64 2019-12-24T23:07:58.911 INFO:teuthology.orchestra.run.smithi152.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.4.1.el7.x86_64.img 2019-12-24T23:07:58.943 INFO:teuthology.orchestra.run.smithi152.stderr:Found linux image: /boot/vmlinuz-3.10.0-957.el7.x86_64 2019-12-24T23:07:58.971 INFO:teuthology.orchestra.run.smithi152.stderr:Found initrd image: /boot/initramfs-3.10.0-957.el7.x86_64.img 2019-12-24T23:07:58.999 INFO:teuthology.orchestra.run.smithi152.stderr:Found linux image: /boot/vmlinuz-0-rescue-a1739c9c60b14f0891126d2e603bb003 2019-12-24T23:07:59.008 INFO:teuthology.orchestra.run.smithi152.stderr:Found initrd image: /boot/initramfs-0-rescue-a1739c9c60b14f0891126d2e603bb003.img 2019-12-24T23:07:59.884 INFO:teuthology.orchestra.run.smithi152.stderr:done 2019-12-24T23:07:59.887 INFO:teuthology.orchestra.run.smithi152:> mktemp 2019-12-24T23:07:59.949 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/tmp.D53lZaTpF5 2019-12-24T23:07:59.950 INFO:teuthology.orchestra.run.smithi152:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.D53lZaTpF5 2019-12-24T23:08:00.020 INFO:teuthology.orchestra.run.smithi152:> sudo chmod 0666 /tmp/tmp.D53lZaTpF5 2019-12-24T23:08:00.132 DEBUG:teuthology.orchestra.remote:smithi152:/tmp/tmp.D53lZaTpF5 is 6KB 2019-12-24T23:08:00.188 INFO:teuthology.orchestra.run.smithi152:> rm -fr /tmp/tmp.D53lZaTpF5 2019-12-24T23:08:00.236 INFO:teuthology.orchestra.run.smithi152:> sudo grub2-set-default 0 2019-12-24T23:08:00.520 INFO:teuthology.orchestra.run.smithi152:> sudo shutdown -r now 2019-12-24T23:08:00.523 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2019-12-24T23:08:00.523 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi130.front.sepia.ceph.com, path=None, version=distro) 2019-12-24T23:08:00.524 INFO:teuthology.orchestra.run.smithi130:> rpm -q kernel --last | head -n 1 2019-12-24T23:08:00.900 INFO:teuthology.orchestra.run.smithi130.stdout:kernel-3.10.0-1062.9.1.el7.x86_64 Tue 24 Dec 2019 11:06:33 PM UTC 2019-12-24T23:08:00.903 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.9.1.el7.x86_64 2019-12-24T23:08:00.903 INFO:teuthology.orchestra.run.smithi130:> sudo rpm -qi grub2-tools 2019-12-24T23:08:01.073 INFO:teuthology.orchestra.run.smithi130.stdout:Name : grub2-tools 2019-12-24T23:08:01.073 INFO:teuthology.orchestra.run.smithi130.stdout:Epoch : 1 2019-12-24T23:08:01.073 INFO:teuthology.orchestra.run.smithi130.stdout:Version : 2.02 2019-12-24T23:08:01.073 INFO:teuthology.orchestra.run.smithi130.stdout:Release : 0.76.el7.centos 2019-12-24T23:08:01.073 INFO:teuthology.orchestra.run.smithi130.stdout:Architecture: x86_64 2019-12-24T23:08:01.073 INFO:teuthology.orchestra.run.smithi130.stdout:Install Date: Tue 05 Nov 2019 03:40:24 PM UTC 2019-12-24T23:08:01.074 INFO:teuthology.orchestra.run.smithi130.stdout:Group : System Environment/Base 2019-12-24T23:08:01.074 INFO:teuthology.orchestra.run.smithi130.stdout:Size : 10080361 2019-12-24T23:08:01.074 INFO:teuthology.orchestra.run.smithi130.stdout:License : GPLv3+ 2019-12-24T23:08:01.074 INFO:teuthology.orchestra.run.smithi130.stdout:Signature : RSA/SHA256, Mon 12 Nov 2018 02:28:11 PM UTC, Key ID 24c6a8a7f4a80eb5 2019-12-24T23:08:01.074 INFO:teuthology.orchestra.run.smithi130.stdout:Source RPM : grub2-2.02-0.76.el7.centos.src.rpm 2019-12-24T23:08:01.074 INFO:teuthology.orchestra.run.smithi130.stdout:Build Date : Fri 09 Nov 2018 12:58:43 AM UTC 2019-12-24T23:08:01.074 INFO:teuthology.orchestra.run.smithi130.stdout:Build Host : kbuilder.bsys.centos.org 2019-12-24T23:08:01.075 INFO:teuthology.orchestra.run.smithi130.stdout:Relocations : (not relocatable) 2019-12-24T23:08:01.075 INFO:teuthology.orchestra.run.smithi130.stdout:Packager : CentOS BuildSystem 2019-12-24T23:08:01.075 INFO:teuthology.orchestra.run.smithi130.stdout:Vendor : CentOS 2019-12-24T23:08:01.075 INFO:teuthology.orchestra.run.smithi130.stdout:URL : http://www.gnu.org/software/grub/ 2019-12-24T23:08:01.075 INFO:teuthology.orchestra.run.smithi130.stdout:Summary : Support tools for GRUB. 2019-12-24T23:08:01.075 INFO:teuthology.orchestra.run.smithi130.stdout:Description : 2019-12-24T23:08:01.075 INFO:teuthology.orchestra.run.smithi130.stdout: 2019-12-24T23:08:01.076 INFO:teuthology.orchestra.run.smithi130.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2019-12-24T23:08:01.076 INFO:teuthology.orchestra.run.smithi130.stdout:customizable bootloader with modular architecture. It supports a rich 2019-12-24T23:08:01.076 INFO:teuthology.orchestra.run.smithi130.stdout:variety of kernel formats, file systems, computer architectures and 2019-12-24T23:08:01.076 INFO:teuthology.orchestra.run.smithi130.stdout:hardware devices. 2019-12-24T23:08:01.077 INFO:teuthology.orchestra.run.smithi130.stdout: 2019-12-24T23:08:01.077 INFO:teuthology.orchestra.run.smithi130.stdout:This subpackage provides tools for support of all platforms. 2019-12-24T23:08:01.078 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2019-12-24T23:08:01.078 INFO:teuthology.task.kernel:Updating grub on smithi130 to boot 3.10.0-1062.9.1.el7.x86_64 2019-12-24T23:08:01.078 INFO:teuthology.orchestra.run.smithi130:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2019-12-24T23:08:01.534 INFO:teuthology.orchestra.run.smithi130.stderr:Generating grub configuration file ... 2019-12-24T23:08:01.670 INFO:teuthology.orchestra.run.smithi130.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.9.1.el7.x86_64 2019-12-24T23:08:01.684 INFO:teuthology.orchestra.run.smithi130.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.9.1.el7.x86_64.img 2019-12-24T23:08:01.924 INFO:teuthology.orchestra.run.smithi130.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.4.1.el7.x86_64 2019-12-24T23:08:01.944 INFO:teuthology.orchestra.run.smithi130.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.4.1.el7.x86_64.img 2019-12-24T23:08:01.977 INFO:teuthology.orchestra.run.smithi130.stderr:Found linux image: /boot/vmlinuz-3.10.0-957.el7.x86_64 2019-12-24T23:08:01.993 INFO:teuthology.orchestra.run.smithi130.stderr:Found initrd image: /boot/initramfs-3.10.0-957.el7.x86_64.img 2019-12-24T23:08:02.022 INFO:teuthology.orchestra.run.smithi130.stderr:Found linux image: /boot/vmlinuz-0-rescue-a1739c9c60b14f0891126d2e603bb003 2019-12-24T23:08:02.030 INFO:teuthology.orchestra.run.smithi130.stderr:Found initrd image: /boot/initramfs-0-rescue-a1739c9c60b14f0891126d2e603bb003.img 2019-12-24T23:08:02.913 INFO:teuthology.orchestra.run.smithi130.stderr:done 2019-12-24T23:08:02.915 INFO:teuthology.orchestra.run.smithi130:> mktemp 2019-12-24T23:08:02.981 INFO:teuthology.orchestra.run.smithi130.stdout:/tmp/tmp.hwFlHGS53g 2019-12-24T23:08:02.982 INFO:teuthology.orchestra.run.smithi130:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.hwFlHGS53g 2019-12-24T23:08:03.060 INFO:teuthology.orchestra.run.smithi130:> sudo chmod 0666 /tmp/tmp.hwFlHGS53g 2019-12-24T23:08:03.193 DEBUG:teuthology.orchestra.remote:smithi130:/tmp/tmp.hwFlHGS53g is 6KB 2019-12-24T23:08:03.249 INFO:teuthology.orchestra.run.smithi130:> rm -fr /tmp/tmp.hwFlHGS53g 2019-12-24T23:08:03.297 INFO:teuthology.orchestra.run.smithi130:> sudo grub2-set-default 0 2019-12-24T23:08:03.538 INFO:teuthology.orchestra.run.smithi130:> sudo shutdown -r now 2019-12-24T23:08:03.541 INFO:teuthology.misc:Re-opening connections... 2019-12-24T23:08:03.542 INFO:teuthology.misc:trying to connect to ubuntu@smithi152.front.sepia.ceph.com 2019-12-24T23:08:03.542 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-24T23:08:03.542 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi152.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T23:09:03.544 DEBUG:teuthology.orchestra.remote:timed out 2019-12-24T23:09:03.544 INFO:teuthology.misc:trying to connect to ubuntu@smithi046.front.sepia.ceph.com 2019-12-24T23:09:03.544 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-24T23:09:03.545 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi046.front.sepia.ceph.com', 'timeout': 60} 2019-12-24T23:09:56.978 DEBUG:teuthology.exit:Got signal 15; running 2 handlers... 2019-12-24T23:09:56.979 DEBUG:teuthology.task.console_log:Killing console logger for smithi152 2019-12-24T23:09:56.979 DEBUG:teuthology.task.console_log:Killing console logger for smithi130 2019-12-24T23:09:56.979 DEBUG:teuthology.task.console_log:Killing console logger for smithi046 2019-12-24T23:09:56.980 DEBUG:teuthology.task.console_log:Killing console logger for smithi152 2019-12-24T23:09:56.980 DEBUG:teuthology.task.console_log:Killing console logger for smithi130 2019-12-24T23:09:56.980 DEBUG:teuthology.task.console_log:Killing console logger for smithi046 2019-12-24T23:09:56.981 DEBUG:teuthology.exit:Finished running handlers