2020-01-27T18:26:21.501 INFO:root:teuthology version: 1.0.0-7063d1e 2020-01-27T18:26:21.501 DEBUG:teuthology.run:Teuthology command: teuthology /tmp/teuthology-worker.GAN2iN.tmp -- --verbose --lock --description upgrade:mimic-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-luminous-install/mimic.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-ec-workload.yaml 5-finish-upgrade.yaml 7-final-workload.yaml objectstore/bluestore-bitmap.yaml supported-all-distro/rhel_7.yaml thrashosds-health.yaml} --name dzafman-2020-01-25_01:21:34-upgrade:mimic-x-master-distro-basic-smithi --block --owner scheduled_dzafman@ubuntu-1804 --archive /home/teuthworker/archive/dzafman-2020-01-25_01:21:34-upgrade:mimic-x-master-distro-basic-smithi/4711850 2020-01-27T18:26:21.568 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-01-27T18:26:21.643 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/dzafman-2020-01-25_01:21:34-upgrade:mimic-x-master-distro-basic-smithi/4711850 branch: master description: upgrade:mimic-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-luminous-install/mimic.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-ec-workload.yaml 5-finish-upgrade.yaml 7-final-workload.yaml objectstore/bluestore-bitmap.yaml supported-all-distro/rhel_7.yaml thrashosds-health.yaml} email: dzafman@redhat.com first_in_suite: false job_id: '4711850' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'Run ceph on two nodes, with a separate client-only node. Use xfs beneath the osds. #Note-To enable RHEL runs on ovh nodes, add the following to overrides #ansible.cephlab: # skip_tags: entitlements,packages,repos ' - desc: install ceph/mimic latest - desc: 'install upgrade ceph/-x on 2/3 of cluster restart : mons, osd 0-7 ' - desc: 'randomly kill and revive osd small chance to increase the number of pgs ' - desc: 'randomized correctness test for rados operations on an erasure coded pool ' - desc: 'randomized correctness test for rados operations on an erasure coded pool using the jerasure plugin with k=3 and m=1 ' name: dzafman-2020-01-25_01:21:34-upgrade:mimic-x-master-distro-basic-smithi nuke-on-error: true openstack: - machine: disk: 100 - volumes: count: 4 size: 30 os_type: rhel os_version: '7.7' overrides: admin_socket: branch: master ceph: conf: global: enable experimental unrecoverable data corrupting features: '*' mon warn on msgr2 not enabled: false mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon warn on osd down out interval zero: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug filestore: 20 debug journal: 20 debug ms: 1 debug osd: 25 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(MON_DOWN\) - \(MGR_DOWN\) - \(MON_MSGR2_NOT_ENABLED\) - but it is still running - wrongly marked me down - objects unfound and apparently lost - log bound mismatch - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow requests mon_bind_addrvec: false mon_bind_msgr2: false sha1: 9c19d0edb97c85432761f769828070f563587117 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: sha1: 9c19d0edb97c85432761f769828070f563587117 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: master sha1: 35b0b52153206fd6178afe584a2cd9c0ef2bcc05 owner: scheduled_dzafman@ubuntu-1804 priority: 50 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - osd.3 - - mon.b - osd.4 - osd.5 - osd.6 - osd.7 - - mon.c - - osd.8 - osd.9 - osd.10 - osd.11 - - client.0 sha1: 9c19d0edb97c85432761f769828070f563587117 stress-tasks: - thrashosds: aggressive_pg_num_changes: false chance_force_recovery: 0 chance_pgnum_grow: 1 chance_pgpnum_fix: 1 chance_thrash_cluster_full: 0 chance_thrash_pg_upmap: 0 chance_thrash_pg_upmap_items: 0 min_in: 4 timeout: 1200 - print: '**** done thrashosds 3-thrash' - rados: clients: - client.0 ec_pool: true objects: 50 op_weights: append: 100 copy_from: 50 delete: 50 read: 100 rmattr: 25 rollback: 50 setattr: 25 snap_create: 50 snap_remove: 50 write: 0 ops: 4000 write_append_excl: false - print: '**** done rados ec task' suite: upgrade:mimic-x suite_branch: master suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_master/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: 35b0b52153206fd6178afe584a2cd9c0ef2bcc05 tasks: - install: branch: mimic exclude_packages: - librados3 - ceph-mgr-dashboard - ceph-mgr-diskprediction-local - ceph-mgr-diskprediction-cloud - ceph-mgr-rook - ceph-mgr-ssh - ceph-daemon extra_packages: - librados2 - print: '**** done install mimic' - ceph: conf: global: bluestore warn on no per pool omap: false bluestore_warn_on_legacy_statfs: false - exec: osd.0: - ceph osd require-osd-release mimic - ceph osd set-require-min-compat-client mimic - print: '**** done ceph' - rgw: - client.0 - print: '**** done => started rgw client.0' - install.upgrade: mon.a: null mon.b: null mon.c: null - print: '**** done install.upgrade first 3 nodes' - ceph.restart: daemons: - mon.a - mon.b - mon.c - mgr.x - osd.0 - osd.1 - osd.2 - osd.3 - osd.4 - osd.5 - osd.6 - osd.7 mon-health-to-clog: false - print: '**** done ceph.restart all mons and 2/3 of osds' - parallel: - stress-tasks - install.upgrade: client.0: null osd.8: null - ceph.restart: daemons: - osd.8 - osd.9 - osd.10 - osd.11 - rgw.* wait-for-healthy: false wait-for-osds-up: true - print: '**** done restarted/upgraded => osd.8, osd.9, osd.10, osd.11, rgw.*' - exec: osd.0: - ceph osd set pglog_hardlimit - ceph osd dump --format=json-pretty | grep "flags" - print: '**** done try to set pglog_hardlimit again, should succeed' - rados: clients: - client.0 ec_pool: true erasure_code_profile: crush-failure-domain: osd k: 3 m: 1 name: jerasure31profile plugin: jerasure technique: reed_sol_van objects: 50 op_weights: append: 100 copy_from: 50 delete: 50 read: 100 rmattr: 25 rollback: 50 setattr: 25 snap_create: 50 snap_remove: 50 write: 0 ops: 4000 write_append_excl: false teuthology_branch: master tube: smithi verbose: false worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.2496 2020-01-27T18:26:21.643 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_master/qa; will attempt to use it 2020-01-27T18:26:21.644 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_master/qa/tasks 2020-01-27T18:26:21.644 INFO:teuthology.run_tasks:Running task internal.check_packages... 2020-01-27T18:26:21.646 INFO:teuthology.task.internal:Checking packages... 2020-01-27T18:26:21.661 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'basic' and ceph hash '9c19d0edb97c85432761f769828070f563587117' 2020-01-27T18:26:21.661 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-01-27T18:26:21.661 INFO:teuthology.packaging:ref: None 2020-01-27T18:26:21.662 INFO:teuthology.packaging:tag: None 2020-01-27T18:26:21.662 INFO:teuthology.packaging:branch: master 2020-01-27T18:26:21.662 INFO:teuthology.packaging:sha1: 9c19d0edb97c85432761f769828070f563587117 2020-01-27T18:26:21.662 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&ref=master 2020-01-27T18:26:22.993 INFO:teuthology.task.internal:Found packages for ceph version 15.0.0-9846.g14d1490 2020-01-27T18:26:22.993 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2020-01-27T18:26:23.002 INFO:teuthology.task.internal:no buildpackages task found 2020-01-27T18:26:23.002 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2020-01-27T18:26:23.059 INFO:teuthology.task.internal.lock_machines:Locking machines... 2020-01-27T18:26:23.059 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-01-27T18:26:23.110 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:26:33.127 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:26:43.140 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:26:53.159 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:27:03.179 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:27:13.189 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:27:23.203 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:27:33.221 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:27:43.239 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:27:53.257 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:28:03.276 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:28:13.295 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:28:23.313 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:28:33.327 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:28:43.344 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:28:53.362 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:29:03.382 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:29:13.398 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:29:23.418 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:29:33.441 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:29:43.459 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:29:53.475 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:30:03.493 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:30:13.511 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:30:23.525 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 6)... 2020-01-27T18:30:33.584 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:30:43.599 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:30:53.615 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:31:03.630 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:31:13.647 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:31:23.662 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:31:33.678 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:31:43.692 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 4)... 2020-01-27T18:31:53.706 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 4)... 2020-01-27T18:32:03.733 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 4)... 2020-01-27T18:32:13.751 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:32:23.767 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:32:33.785 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:32:43.803 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:32:53.819 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:33:03.839 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:33:13.856 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:33:23.874 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:33:33.892 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:33:43.903 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:33:53.919 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:34:03.931 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 4)... 2020-01-27T18:34:13.947 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 4)... 2020-01-27T18:34:23.965 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 4)... 2020-01-27T18:34:33.977 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 4)... 2020-01-27T18:34:44.002 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:34:54.015 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:35:04.031 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:35:14.047 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:35:24.067 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 4)... 2020-01-27T18:35:34.083 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 6)... 2020-01-27T18:35:44.102 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:35:54.124 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:36:04.143 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:36:14.161 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:36:24.179 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:36:34.197 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:36:44.215 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:36:54.231 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 4)... 2020-01-27T18:37:04.247 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 4)... 2020-01-27T18:37:14.264 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 4)... 2020-01-27T18:37:24.283 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 4)... 2020-01-27T18:37:34.300 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 4)... 2020-01-27T18:37:44.315 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 4)... 2020-01-27T18:37:54.332 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:38:04.348 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:38:14.362 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 5)... 2020-01-27T18:38:24.379 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 5)... 2020-01-27T18:38:34.397 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 5)... 2020-01-27T18:38:44.415 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 5)... 2020-01-27T18:38:54.434 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:39:04.453 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:39:14.472 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:39:24.490 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:39:34.505 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:39:44.523 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:39:54.542 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:40:04.559 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:40:14.579 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:40:24.600 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:40:34.654 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:40:44.669 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:40:54.687 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:41:04.702 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:41:14.720 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:41:24.738 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:41:34.756 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:41:44.776 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:41:54.796 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:42:04.815 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:42:14.832 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:42:24.851 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:42:34.866 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:42:44.893 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:42:54.909 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:43:04.928 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:43:14.947 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:43:24.965 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:43:34.987 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:43:45.003 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:43:55.021 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:44:05.036 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:44:15.054 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:44:25.074 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:44:35.091 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:44:45.108 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:44:55.127 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:45:05.146 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:45:15.161 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:45:25.181 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:45:35.197 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:45:45.215 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:45:55.230 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:46:05.248 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:46:15.262 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:46:25.272 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:46:35.291 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:46:45.309 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:46:55.330 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:47:05.349 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:47:15.366 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:47:25.384 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:47:35.403 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:47:45.422 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 4)... 2020-01-27T18:47:55.436 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 4)... 2020-01-27T18:48:05.451 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 4)... 2020-01-27T18:48:15.471 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 4)... 2020-01-27T18:48:25.493 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 4)... 2020-01-27T18:48:35.507 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 4)... 2020-01-27T18:48:45.525 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 4)... 2020-01-27T18:48:55.542 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:49:05.558 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:49:15.574 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:49:25.591 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:49:35.607 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:49:45.625 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:49:55.643 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:50:05.661 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:50:15.675 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:50:25.691 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:50:35.702 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:50:45.719 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:50:55.735 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:51:05.747 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:51:15.759 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:51:25.772 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:51:35.791 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:51:45.810 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 4)... 2020-01-27T18:51:55.830 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:52:05.848 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:52:15.866 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:52:25.882 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:52:35.895 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:52:45.915 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:52:55.931 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:53:05.951 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:53:15.970 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:53:25.986 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:53:35.996 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:53:46.017 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:53:56.032 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:54:06.052 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:54:16.067 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:54:26.086 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 4)... 2020-01-27T18:54:36.104 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 4)... 2020-01-27T18:54:46.116 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 4)... 2020-01-27T18:54:56.133 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 4)... 2020-01-27T18:55:06.144 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:55:16.156 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:55:26.175 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:55:36.186 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:55:46.205 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:55:56.223 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:56:06.234 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:56:16.248 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:56:26.267 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:56:36.285 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:56:46.302 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:56:56.319 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:57:06.338 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:57:16.360 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:57:26.379 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:57:36.394 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:57:46.411 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:57:56.421 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:58:06.432 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:58:16.451 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:58:26.470 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:58:36.479 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:58:46.491 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:58:56.509 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:59:06.522 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:59:16.540 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:59:26.551 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:59:36.569 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:59:46.588 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:59:56.607 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:00:06.625 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:00:16.636 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:00:26.655 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:00:36.667 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:00:46.683 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:00:56.700 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:01:06.723 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:01:16.738 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:01:26.755 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:01:36.773 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:01:46.792 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:01:56.811 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:02:06.832 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:02:16.843 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:02:26.862 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:02:36.874 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:02:46.884 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:02:56.903 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:03:06.918 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:03:16.929 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:03:26.948 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:03:36.967 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:03:46.985 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:03:57.003 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:04:07.020 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:04:17.038 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:04:27.058 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:04:37.075 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:04:47.090 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:04:57.101 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:05:07.113 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:05:17.132 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:05:27.148 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:05:37.166 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:05:47.185 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:05:57.205 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:06:07.223 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:06:17.241 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:06:27.260 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:06:37.275 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:06:47.294 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:06:57.313 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:07:07.331 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:07:17.346 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:07:27.363 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:07:37.375 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:07:47.391 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:07:57.408 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:08:07.422 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:08:17.441 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:08:27.459 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:08:37.477 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:08:47.492 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:08:57.509 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:09:07.527 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:09:17.545 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:09:27.558 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:09:37.574 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:09:47.592 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:09:57.606 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:10:07.616 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:10:17.634 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:10:27.650 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:10:37.666 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:10:47.675 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:10:57.695 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:11:07.711 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:11:17.729 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:11:27.747 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:11:37.762 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:11:47.776 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:11:57.796 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:12:07.810 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:12:17.828 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:12:27.843 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:12:37.858 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:12:47.876 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:12:57.894 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:13:07.912 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:13:17.931 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:13:27.946 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:13:37.964 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:13:47.982 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:13:58.014 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:14:08.031 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:14:18.043 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:14:28.052 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:14:38.071 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:14:48.085 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:14:58.101 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:15:08.113 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:15:18.134 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:15:28.178 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:15:38.195 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 5)... 2020-01-27T19:15:48.211 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:15:58.229 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 4)... 2020-01-27T19:16:08.247 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:16:18.266 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:16:28.284 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:16:38.294 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:16:48.306 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:16:58.322 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:17:08.361 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:17:18.385 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:17:28.402 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:17:38.414 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:17:48.431 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:17:58.450 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:18:08.466 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:18:18.483 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:18:28.493 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:18:38.510 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:18:48.526 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 4)... 2020-01-27T19:18:58.545 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 4)... 2020-01-27T19:19:08.564 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 5)... 2020-01-27T19:19:18.577 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:19:28.589 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:19:38.604 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:19:48.618 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:19:58.637 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:20:08.647 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:20:18.662 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:20:28.675 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:20:38.690 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:20:48.702 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:20:58.720 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:21:08.737 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:21:18.752 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:21:28.770 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:21:38.787 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:21:48.804 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:21:58.819 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:22:08.836 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 5)... 2020-01-27T19:22:18.844 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:22:28.861 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:22:38.877 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:22:48.894 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:22:58.910 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:23:08.926 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:23:18.943 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:23:28.959 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:23:38.977 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:23:48.994 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:23:59.012 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:24:09.030 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:24:19.046 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:24:29.066 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:24:39.078 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:24:49.095 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:24:59.112 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:25:09.131 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:25:19.150 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:25:29.167 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:25:39.183 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:25:49.200 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:25:59.214 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:26:09.232 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:26:19.250 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:26:29.266 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:26:39.285 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:26:49.299 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:26:59.313 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:27:09.331 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:27:19.352 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:27:29.367 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:27:39.385 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:27:49.403 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:27:59.418 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:28:09.433 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:28:19.452 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:28:29.461 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)...