2020-01-27T18:36:39.042 INFO:root:teuthology version: 1.0.0-7063d1e 2020-01-27T18:36:39.042 DEBUG:teuthology.run:Teuthology command: teuthology /tmp/teuthology-worker.VWfJQn.tmp -- --verbose --lock --description upgrade:mimic-x/stress-split/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/mimic.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml rgw_ragweed_prepare.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 6-msgr2.yaml 6-nautilus.yaml 7-final-workload/{rbd-python.yaml rgw-swift-ragweed_check.yaml snaps-many-objects.yaml} objectstore/filestore-xfs.yaml supported-all-distro/rhel_7.yaml thrashosds-health.yaml} --name dzafman-2020-01-25_01:21:34-upgrade:mimic-x-master-distro-basic-smithi --block --owner scheduled_dzafman@ubuntu-1804 --archive /home/teuthworker/archive/dzafman-2020-01-25_01:21:34-upgrade:mimic-x-master-distro-basic-smithi/4711858 2020-01-27T18:36:39.121 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-01-27T18:36:39.202 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/dzafman-2020-01-25_01:21:34-upgrade:mimic-x-master-distro-basic-smithi/4711858 branch: master description: upgrade:mimic-x/stress-split/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/mimic.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml rgw_ragweed_prepare.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 6-msgr2.yaml 6-nautilus.yaml 7-final-workload/{rbd-python.yaml rgw-swift-ragweed_check.yaml snaps-many-objects.yaml} objectstore/filestore-xfs.yaml supported-all-distro/rhel_7.yaml thrashosds-health.yaml} email: dzafman@redhat.com first_in_suite: false job_id: '4711858' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'Run ceph on two nodes, with a separate client-only node. Use xfs beneath the osds. #Note-To enable RHEL runs on ovh nodes, add the following to overrides #ansible.cephlab: # skip_tags: entitlements,packages,repos ' - desc: install ceph/mimic latest - desc: 'install upgrade ceph/-x on 2/3 of cluster restart : mons, osd 0-7 ' - desc: 'randomly kill and revive osd small chance to increase the number of pgs ' - desc: 'run randomized correctness test for rados operations generate write load with rados bench ' - desc: 'run basic cls tests for rbd ' - desc: 'run basic import/export cli tests for rbd ' - desc: 'librbd C and C++ api tests ' - desc: 'randomized correctness test for rados operations on a replicated pool, using only reads, writes, and deletes ' - desc: 'rgw ragweed prepare before upgrade ' - desc: 'randomized correctness test for rados operations on a replicated pool with snapshot operations ' - desc: 'librbd python api tests ' - desc: 'swift api tests for rgw rgw ragweed check after upgrade ' - desc: 'randomized correctness test for rados operations on a replicated pool with snapshot operations ' name: dzafman-2020-01-25_01:21:34-upgrade:mimic-x-master-distro-basic-smithi nuke-on-error: true openstack: - machine: disk: 100 - volumes: count: 4 size: 30 os_type: rhel os_version: '7.7' overrides: admin_socket: branch: master ceph: conf: global: enable experimental unrecoverable data corrupting features: '*' mon warn on msgr2 not enabled: false mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon warn on osd down out interval zero: false osd: debug filestore: 20 debug journal: 20 debug ms: 1 debug osd: 25 osd objectstore: filestore osd sloppy crc: true fs: xfs log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(MON_DOWN\) - \(MGR_DOWN\) - \(MON_MSGR2_NOT_ENABLED\) - but it is still running - wrongly marked me down - objects unfound and apparently lost - log bound mismatch - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow requests mon_bind_addrvec: false mon_bind_msgr2: false sha1: 9c19d0edb97c85432761f769828070f563587117 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: osd objectstore: filestore osd sloppy crc: true filestore: true fs: xfs install: ceph: sha1: 9c19d0edb97c85432761f769828070f563587117 workunit: branch: master sha1: 35b0b52153206fd6178afe584a2cd9c0ef2bcc05 owner: scheduled_dzafman@ubuntu-1804 priority: 50 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - osd.3 - - mon.b - osd.4 - osd.5 - osd.6 - osd.7 - - mon.c - - osd.8 - osd.9 - osd.10 - osd.11 - - client.0 sha1: 9c19d0edb97c85432761f769828070f563587117 stress-tasks: - thrashosds: aggressive_pg_num_changes: false chance_force_recovery: 0 chance_pgnum_grow: 1 chance_pgpnum_fix: 1 chance_thrash_cluster_full: 0 chance_thrash_pg_upmap: 0 chance_thrash_pg_upmap_items: 0 disable_objectstore_tool_tests: true timeout: 1200 - print: '**** done thrashosds 3-thrash' - full_sequential: - radosbench: clients: - client.0 time: 90 - radosbench: clients: - client.0 time: 90 - radosbench: clients: - client.0 time: 90 - radosbench: clients: - client.0 time: 90 - radosbench: clients: - client.0 time: 90 - radosbench: clients: - client.0 time: 90 - radosbench: clients: - client.0 time: 90 - radosbench: clients: - client.0 time: 90 - radosbench: clients: - client.0 time: 90 - radosbench: clients: - client.0 time: 90 - radosbench: clients: - client.0 time: 90 - radosbench: clients: - client.0 time: 90 - radosbench: clients: - client.0 time: 90 - radosbench: clients: - client.0 time: 90 - radosbench: clients: - client.0 time: 90 - print: '**** done radosbench 7-workload' - workunit: branch: mimic clients: client.0: - cls/test_cls_rbd.sh - print: '**** done cls/test_cls_rbd.sh 5-workload' - workunit: branch: mimic clients: client.0: - rbd/import_export.sh env: RBD_CREATE_ARGS: --new-format - print: '**** done rbd/import_export.sh 5-workload' - workunit: branch: mimic clients: client.0: - rbd/test_librbd.sh - print: '**** done rbd/test_librbd.sh 7-workload' - full_sequential: - rados: clients: - client.0 objects: 500 op_weights: delete: 10 read: 45 write: 45 ops: 4000 write_append_excl: false - print: '**** done rados/readwrite 5-workload' - full_sequential: - sequential: - ragweed: client.0: default-branch: ceph-nautilus rgw_server: client.0 stages: prepare - print: '**** done rgw ragweed prepare 4-workload' - full_sequential: - rados: clients: - client.0 objects: 50 op_weights: delete: 50 read: 100 rollback: 50 snap_create: 50 snap_remove: 50 write: 100 ops: 4000 write_append_excl: false - print: '**** done rados/snaps-few-objects 5-workload' suite: upgrade:mimic-x suite_branch: master suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_master/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: 35b0b52153206fd6178afe584a2cd9c0ef2bcc05 tasks: - install: branch: mimic exclude_packages: - librados3 - ceph-mgr-dashboard - ceph-mgr-diskprediction-local - ceph-mgr-diskprediction-cloud - ceph-mgr-rook - ceph-mgr-ssh - ceph-daemon extra_packages: - librados2 - print: '**** done install mimic' - ceph: conf: global: bluestore warn on no per pool omap: false bluestore_warn_on_legacy_statfs: false - exec: osd.0: - ceph osd require-osd-release mimic - ceph osd set-require-min-compat-client mimic - print: '**** done ceph' - rgw: - client.0 - print: '**** done => started rgw client.0' - install.upgrade: mon.a: null mon.b: null mon.c: null - print: '**** done install.upgrade first 3 nodes' - ceph.restart: daemons: - mon.a - mon.b - mon.c - mgr.x - osd.0 - osd.1 - osd.2 - osd.3 - osd.4 - osd.5 - osd.6 - osd.7 mon-health-to-clog: false - print: '**** done ceph.restart all mons and 2/3 of osds' - parallel: - stress-tasks - install.upgrade: client.0: null osd.8: null - ceph.restart: daemons: - osd.8 - osd.9 - osd.10 - osd.11 - rgw.* wait-for-healthy: false wait-for-osds-up: true - print: '**** done restarted/upgraded => osd.8, osd.9, osd.10, osd.11, rgw.*' - exec: osd.0: - ceph osd set pglog_hardlimit - ceph osd dump --format=json-pretty | grep "flags" - print: '**** done try to set pglog_hardlimit again, should succeed' - exec: mon.a: - ceph mon enable-msgr2 - ceph.healthy: null - exec: osd.0: - ceph osd require-osd-release nautilus - ceph osd set-require-min-compat-client nautilus - for p in `ceph osd pool ls`; do ceph osd pool set $p pg_autoscale_mode off; done - ceph.healthy: null - workunit: branch: mimic clients: client.0: - rbd/test_librbd_python.sh - print: '**** done rbd/test_librbd_python.sh 9-workload' - swift: client.0: rgw_server: client.0 - print: '**** done swift 7-workload' - ragweed: client.0: default-branch: ceph-nautilus rgw_server: client.0 stages: check - print: '**** done rgw ragweed check 7-workload' - rados: clients: - client.0 objects: 500 op_weights: delete: 50 read: 100 rollback: 50 snap_create: 50 snap_remove: 50 write: 100 ops: 4000 write_append_excl: false teuthology_branch: master tube: smithi verbose: false worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.17179 2020-01-27T18:36:39.203 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_master/qa; will attempt to use it 2020-01-27T18:36:39.203 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_master/qa/tasks 2020-01-27T18:36:39.203 INFO:teuthology.run_tasks:Running task internal.check_packages... 2020-01-27T18:36:39.206 INFO:teuthology.task.internal:Checking packages... 2020-01-27T18:36:39.218 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'basic' and ceph hash '9c19d0edb97c85432761f769828070f563587117' 2020-01-27T18:36:39.219 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-01-27T18:36:39.219 INFO:teuthology.packaging:ref: None 2020-01-27T18:36:39.219 INFO:teuthology.packaging:tag: None 2020-01-27T18:36:39.219 INFO:teuthology.packaging:branch: master 2020-01-27T18:36:39.219 INFO:teuthology.packaging:sha1: 9c19d0edb97c85432761f769828070f563587117 2020-01-27T18:36:39.219 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&ref=master 2020-01-27T18:36:40.769 INFO:teuthology.task.internal:Found packages for ceph version 15.0.0-9849.ge33f610 2020-01-27T18:36:40.769 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2020-01-27T18:36:40.779 INFO:teuthology.task.internal:no buildpackages task found 2020-01-27T18:36:40.779 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2020-01-27T18:36:40.794 INFO:teuthology.task.internal.lock_machines:Locking machines... 2020-01-27T18:36:40.794 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-01-27T18:36:40.850 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:36:50.867 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:37:00.886 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 4)... 2020-01-27T18:37:10.903 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 4)... 2020-01-27T18:37:20.919 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 4)... 2020-01-27T18:37:30.935 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 4)... 2020-01-27T18:37:40.948 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 4)... 2020-01-27T18:37:50.967 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:38:00.984 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:38:10.998 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:38:21.017 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 5)... 2020-01-27T18:38:31.036 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 5)... 2020-01-27T18:38:41.055 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 5)... 2020-01-27T18:38:51.073 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 5)... 2020-01-27T18:39:01.091 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:39:11.101 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:39:21.120 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:39:31.137 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:39:41.155 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:39:51.174 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:40:01.193 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:40:11.212 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:40:21.232 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:40:31.257 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:40:41.275 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:40:51.288 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:41:01.300 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:41:11.314 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:41:21.331 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:41:31.351 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:41:41.368 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:41:51.383 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:42:01.400 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:42:11.419 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:42:21.431 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:42:31.442 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:42:41.459 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 4)... 2020-01-27T18:42:51.478 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:43:01.495 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:43:11.508 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:43:21.526 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:43:31.543 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:43:41.559 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:43:51.575 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:44:01.591 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:44:11.607 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:44:21.624 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:44:31.642 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:44:41.659 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:44:51.677 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:45:01.696 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:45:11.709 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:45:21.728 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:45:31.743 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:45:41.761 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:45:51.772 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:46:01.782 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:46:11.799 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:46:21.820 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:46:31.837 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:46:41.855 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:46:51.874 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:47:01.892 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:47:11.907 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:47:21.919 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:47:31.934 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:47:41.950 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 4)... 2020-01-27T18:47:51.960 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 4)... 2020-01-27T18:48:01.976 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 4)... 2020-01-27T18:48:11.991 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 4)... 2020-01-27T18:48:22.007 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 4)... 2020-01-27T18:48:32.029 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 4)... 2020-01-27T18:48:42.047 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 4)... 2020-01-27T18:48:52.065 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:49:02.084 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:49:12.096 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:49:22.115 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:49:32.127 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:49:42.137 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:49:52.158 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:50:02.176 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:50:12.187 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:50:22.205 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:50:32.224 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:50:42.258 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:50:52.276 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:51:02.295 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:51:12.311 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:51:22.326 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:51:32.342 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:51:42.359 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 4)... 2020-01-27T18:51:52.375 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:52:02.393 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:52:12.408 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:52:22.427 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:52:32.442 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:52:42.459 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:52:52.476 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:53:02.494 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:53:12.510 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:53:22.529 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:53:32.548 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:53:42.562 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:53:52.581 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:54:02.590 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:54:12.607 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T18:54:22.624 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 4)... 2020-01-27T18:54:32.641 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 4)... 2020-01-27T18:54:42.655 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 4)... 2020-01-27T18:54:52.670 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 4)... 2020-01-27T18:55:02.682 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:55:12.699 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:55:22.718 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:55:32.736 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:55:42.754 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:55:52.770 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:56:02.787 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:56:12.797 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:56:22.814 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:56:32.825 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:56:42.843 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:56:52.861 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:57:02.881 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:57:13.140 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:57:23.154 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:57:33.172 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:57:43.191 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:57:53.210 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:58:03.227 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:58:13.245 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:58:23.264 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:58:33.279 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:58:43.297 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:58:53.314 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:59:03.333 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:59:13.350 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:59:23.369 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:59:33.388 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T18:59:43.407 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 5)... 2020-01-27T18:59:53.426 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:00:03.442 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:00:13.460 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:00:23.475 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:00:33.491 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:00:43.507 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:00:53.522 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:01:03.542 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:01:13.561 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:01:23.575 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:01:33.588 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:01:43.606 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:01:53.629 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:02:03.638 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:02:13.655 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:02:23.671 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:02:33.683 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:02:43.701 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:02:53.719 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:03:03.738 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:03:13.756 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:03:23.774 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:03:33.791 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:03:43.806 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 5)... 2020-01-27T19:03:53.822 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:04:03.840 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:04:13.856 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:04:23.871 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:04:33.889 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:04:43.907 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:04:53.926 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:05:03.943 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:05:13.960 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:05:23.979 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:05:33.993 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:05:44.011 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:05:54.023 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:06:04.040 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:06:14.057 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:06:24.075 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:06:34.093 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:06:44.108 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:06:54.126 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:07:04.142 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:07:14.160 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:07:24.177 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:07:34.194 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:07:44.210 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:07:54.227 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:08:04.241 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:08:14.258 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:08:24.275 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:08:34.292 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:08:44.309 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:08:54.326 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:09:04.336 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:09:14.347 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:09:24.363 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:09:34.394 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:09:44.411 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:09:54.425 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:10:04.442 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:10:14.460 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:10:24.475 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:10:34.483 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:10:44.498 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:10:54.513 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:11:04.532 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:11:14.550 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:11:24.568 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:11:34.587 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:11:44.603 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:11:54.620 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:12:04.629 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:12:14.654 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:12:24.670 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:12:34.686 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:12:44.699 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:12:54.710 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:13:04.727 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:13:14.745 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:13:24.761 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:13:34.769 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:13:44.784 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:13:54.801 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:14:04.818 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:14:14.832 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:14:24.850 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:14:34.862 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:14:44.873 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:14:54.882 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:15:04.897 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:15:14.912 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:15:24.926 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:15:34.941 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:15:44.958 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:15:54.974 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 4)... 2020-01-27T19:16:04.991 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:16:15.016 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:16:25.183 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:16:35.199 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:16:45.216 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:16:55.229 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:17:05.244 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:17:15.260 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:17:25.278 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:17:35.287 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:17:45.303 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:17:55.314 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:18:05.329 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:18:15.346 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:18:25.361 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:18:35.378 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:18:45.395 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 4)... 2020-01-27T19:18:55.413 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 4)... 2020-01-27T19:19:05.430 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 5)... 2020-01-27T19:19:15.442 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:19:25.451 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:19:35.466 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:19:45.479 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:19:55.496 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:20:05.514 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:20:15.530 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:20:25.547 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:20:35.563 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:20:45.578 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:20:55.593 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:21:05.605 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:21:15.614 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:21:25.630 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:21:35.641 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:21:45.658 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:21:55.674 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:22:05.687 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 3)... 2020-01-27T19:22:15.699 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:22:25.715 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:22:35.734 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:22:45.744 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:22:55.757 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:23:05.772 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:23:15.789 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:23:25.805 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:23:35.822 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:23:45.839 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:23:55.856 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:24:05.873 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:24:15.883 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:24:25.896 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:24:35.914 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:24:45.931 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:24:55.945 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:25:05.963 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:25:15.978 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:25:25.996 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:25:36.012 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:25:46.029 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:25:56.045 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:26:06.062 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:26:16.077 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:26:26.095 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:26:36.112 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:26:46.125 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:26:56.142 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:27:06.160 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:27:16.179 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:27:26.190 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:27:36.202 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:27:46.217 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:27:56.236 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:28:06.249 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:28:16.266 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)... 2020-01-27T19:28:26.282 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 5, have 2)...