2020-04-11T20:43:01.242 INFO:root:teuthology version: 1.0.0-df3de94 2020-04-11T20:43:01.243 DEBUG:teuthology.run:Teuthology command: teuthology /tmp/teuthology-worker.WKS_nX.tmp -- --verbose --lock --description upgrade/nautilus-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-nautilus-install/nautilus.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 3.1-objectstore/filestore-xfs.yaml 4-ec-workload/{rados-ec-workload.yaml rbd-ec-workload.yaml} 5-finish-upgrade.yaml 6-octopus.yaml 7-final-workload.yaml thrashosds-health.yaml ubuntu_latest.yaml} --name sage-2020-04-11_20:38:58-upgrade-wip-sage3-testing-2020-04-11-0952-distro-basic-smithi --block --owner scheduled_sage@teuthology --archive /home/teuthworker/archive/sage-2020-04-11_20:38:58-upgrade-wip-sage3-testing-2020-04-11-0952-distro-basic-smithi/4945665 2020-04-11T20:43:01.350 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-04-11T20:43:01.435 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/sage-2020-04-11_20:38:58-upgrade-wip-sage3-testing-2020-04-11-0952-distro-basic-smithi/4945665 branch: wip-sage3-testing-2020-04-11-0952 description: upgrade/nautilus-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-nautilus-install/nautilus.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 3.1-objectstore/filestore-xfs.yaml 4-ec-workload/{rados-ec-workload.yaml rbd-ec-workload.yaml} 5-finish-upgrade.yaml 6-octopus.yaml 7-final-workload.yaml thrashosds-health.yaml ubuntu_latest.yaml} email: null exclude_arch: armv7l first_in_suite: false job_id: '4945665' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'Run ceph on two nodes, with a separate client-only node. Use xfs beneath the osds. ' - desc: install ceph/nautilus latest - desc: 'install upgrade ceph/-x on 2/3 of cluster restart : mons, osd.0-7 ' - desc: 'randomly kill and revive osd small chance to increase the number of pgs ' - desc: 'randomized correctness test for rados operations on an erasure coded pool ' - desc: 'run rbd tests on EC pool overrides => force bluestore since it''s required for ec-overwrite use an EC pool for rbd and run xfstests on top of it to verify correctness ' - desc: 'randomized correctness test for rados operations on an erasure coded pool using the jerasure plugin with k=3 and m=1 ' name: sage-2020-04-11_20:38:58-upgrade-wip-sage3-testing-2020-04-11-0952-distro-basic-smithi nuke-on-error: true openstack: - machine: disk: 100 - volumes: count: 4 size: 30 os_type: ubuntu os_version: '18.04' overrides: admin_socket: branch: wip-sage3-testing-2020-04-11-0952 ceph: conf: client: rbd default data pool: datapool global: enable experimental unrecoverable data corrupting features: '*' mon warn on msgr2 not enabled: false mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon warn on osd down out interval zero: false osd: debug filestore: 20 debug journal: 20 debug ms: 20 debug osd: 25 osd max markdown count: 1000 osd max pg log entries: 2 osd min pg log entries: 1 osd objectstore: bluestore osd sloppy crc: true fs: xfs log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(MON_DOWN\) - \(MGR_DOWN\) - slow request - \(MON_MSGR2_NOT_ENABLED\) - but it is still running - wrongly marked me down - objects unfound and apparently lost - log bound mismatch - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request mon_bind_addrvec: false mon_bind_msgr2: false sha1: 2f4c54498de31138e119829fdb4e552c0f7e6ff5 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: osd objectstore: filestore osd sloppy crc: true filestore: true fs: xfs install: ceph: sha1: 2f4c54498de31138e119829fdb4e552c0f7e6ff5 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-sage3-testing-2020-04-11-0952 sha1: 2f4c54498de31138e119829fdb4e552c0f7e6ff5 owner: scheduled_sage@teuthology priority: 70 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - osd.3 - - mon.b - osd.4 - osd.5 - osd.6 - osd.7 - - mon.c - - osd.8 - osd.9 - osd.10 - osd.11 - - client.0 sha1: 2f4c54498de31138e119829fdb4e552c0f7e6ff5 stress-tasks: - thrashosds: aggressive_pg_num_changes: false chance_force_recovery: 0 chance_pgnum_grow: 1 chance_pgpnum_fix: 1 chance_thrash_cluster_full: 0 chance_thrash_pg_upmap: 0 chance_thrash_pg_upmap_items: 0 disable_objectstore_tool_tests: true min_in: 4 timeout: 1200 - print: '**** done thrashosds 3-thrash' - rados: clients: - client.0 ec_pool: true objects: 50 op_weights: append: 100 copy_from: 50 delete: 50 read: 100 rmattr: 25 rollback: 50 setattr: 25 snap_create: 50 snap_remove: 50 write: 0 ops: 4000 write_append_excl: false - print: '**** done rados ec task' suite: upgrade suite_branch: wip-sage3-testing-2020-04-11-0952 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_wip-sage3-testing-2020-04-11-0952/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: 2f4c54498de31138e119829fdb4e552c0f7e6ff5 tasks: - install: branch: nautilus exclude_packages: - ceph-mgr-cephadm - cephadm - libcephfs-dev - print: '**** done install nautilus' - ceph: conf: global: bluestore warn on no per pool omap: false bluestore_warn_on_legacy_statfs: false mon pg warn min per osd: 0 log-whitelist: - Not found or unloadable - exec: osd.0: - ceph osd require-osd-release nautilus - ceph osd set-require-min-compat-client nautilus - print: '**** done ceph' - rgw: - client.0 - print: '**** done => started rgw client.0' - install.upgrade: mon.a: null mon.b: null mon.c: null - print: '**** done install.upgrade of first 3 nodes' - ceph.restart: daemons: - mon.a - mon.b - mgr.x - osd.0 - osd.1 - osd.2 - osd.3 - osd.4 - osd.5 - osd.6 - osd.7 mon-health-to-clog: false - print: '**** done ceph.restart of all mons and 2/3 of osds' - parallel: - stress-tasks - exec: client.0: - sudo ceph osd erasure-code-profile set teuthologyprofile crush-failure-domain=osd m=1 k=2 - sudo ceph osd pool create datapool 4 4 erasure teuthologyprofile - sudo ceph osd pool set datapool allow_ec_overwrites true - rbd pool init datapool - qemu: all: clone: true disks: 3 test: qa/run_xfstests_qemu.sh type: block - print: '**** done rbd/qemu ec task' - install.upgrade: client.0: null extra_packages: - python3-rados - python3-rgw - python3-rbd - python3-cephfs osd.8: null - ceph.restart: daemons: - mon.c - osd.8 - osd.9 - osd.10 - osd.11 - rgw.* wait-for-healthy: false wait-for-osds-up: true - print: '**** restarted/upgrated => mon.c, osd.8, osd.9, osd.10, osd.11, rgw.*' - exec: osd.0: - ceph osd set pglog_hardlimit - ceph osd dump --format=json-pretty | grep "flags" - ceph config set global mon_warn_on_msgr2_not_enabled false - print: '**** try to set pglog_hardlimit again, should succeed' - exec: osd.0: - ceph osd require-osd-release octopus - ceph osd set-require-min-compat-client octopus - for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done - ceph.healthy: null - rados: clients: - client.0 ec_pool: true erasure_code_profile: crush-failure-domain: osd k: 3 m: 1 name: jerasure31profile plugin: jerasure technique: reed_sol_van objects: 50 op_weights: append: 100 copy_from: 50 delete: 50 read: 100 rmattr: 25 rollback: 50 setattr: 25 snap_create: 50 snap_remove: 50 write: 0 ops: 4000 write_append_excl: false teuthology_branch: master tube: smithi verbose: false worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.27855 2020-04-11T20:43:01.435 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_wip-sage3-testing-2020-04-11-0952/qa; will attempt to use it 2020-04-11T20:43:01.436 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_wip-sage3-testing-2020-04-11-0952/qa/tasks 2020-04-11T20:43:01.437 INFO:teuthology.run_tasks:Running task internal.check_packages... 2020-04-11T20:43:01.438 INFO:teuthology.task.internal:Checking packages... 2020-04-11T20:43:01.454 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'basic' and ceph hash '2f4c54498de31138e119829fdb4e552c0f7e6ff5' 2020-04-11T20:43:01.454 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-04-11T20:43:01.455 INFO:teuthology.packaging:ref: None 2020-04-11T20:43:01.455 INFO:teuthology.packaging:tag: None 2020-04-11T20:43:01.455 INFO:teuthology.packaging:branch: wip-sage3-testing-2020-04-11-0952 2020-04-11T20:43:01.455 INFO:teuthology.packaging:sha1: 2f4c54498de31138e119829fdb4e552c0f7e6ff5 2020-04-11T20:43:01.455 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&ref=wip-sage3-testing-2020-04-11-0952 2020-04-11T20:43:01.710 INFO:teuthology.task.internal:Found packages for ceph version 16.0.0-629-g2f4c544-1bionic 2020-04-11T20:43:01.711 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2020-04-11T20:43:01.723 INFO:teuthology.task.internal:no buildpackages task found 2020-04-11T20:43:01.723 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2020-04-11T20:43:01.851 INFO:teuthology.task.internal.lock_machines:Locking machines... 2020-04-11T20:43:01.852 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-04-11T20:43:01.901 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T20:43:11.917 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 2)... 2020-04-11T20:43:21.939 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 2)... 2020-04-11T20:43:31.956 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 2)... 2020-04-11T20:43:41.973 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 2)... 2020-04-11T20:43:51.985 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 2)... 2020-04-11T20:44:02.013 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 2)... 2020-04-11T20:44:12.031 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 2)... 2020-04-11T20:44:22.048 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 2)... 2020-04-11T20:44:32.077 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 2)... 2020-04-11T20:44:42.099 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 2)... 2020-04-11T20:44:52.125 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T20:45:02.143 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 2)... 2020-04-11T20:45:12.160 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 2)... 2020-04-11T20:45:22.179 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 1)... 2020-04-11T20:45:32.193 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 2)... 2020-04-11T20:45:42.218 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 2)... 2020-04-11T20:45:52.233 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 2)... 2020-04-11T20:46:02.251 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 2)... 2020-04-11T20:46:12.317 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 2)... 2020-04-11T20:46:22.354 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 2)... 2020-04-11T20:46:32.376 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 2)... 2020-04-11T20:46:42.395 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 4)... 2020-04-11T20:46:52.433 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 1)... 2020-04-11T20:47:02.451 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 1)... 2020-04-11T20:47:12.467 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 3)... 2020-04-11T20:47:22.485 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T20:47:32.501 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 1)... 2020-04-11T20:47:42.519 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 1)... 2020-04-11T20:47:52.540 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 1)... 2020-04-11T20:48:02.562 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T20:48:12.577 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T20:48:22.594 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 2)... 2020-04-11T20:48:32.618 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T20:48:42.629 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 1)... 2020-04-11T20:48:52.645 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 1)... 2020-04-11T20:49:02.661 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 1)... 2020-04-11T20:49:12.682 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T20:49:22.700 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T20:49:32.721 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T20:49:42.737 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T20:49:52.755 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T20:50:02.773 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 2)... 2020-04-11T20:50:12.785 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T20:50:22.802 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T20:50:32.819 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 2)... 2020-04-11T20:50:42.833 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T20:50:52.849 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 2)... 2020-04-11T20:51:02.872 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T20:51:12.890 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T20:51:22.913 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T20:51:32.938 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T20:51:42.953 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T20:51:52.972 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T20:52:02.989 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T20:52:13.005 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T20:52:23.022 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 1)... 2020-04-11T20:52:33.041 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 1)... 2020-04-11T20:52:43.067 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 2)... 2020-04-11T20:52:53.082 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 2)... 2020-04-11T20:53:03.110 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T20:53:13.125 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T20:53:23.140 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T20:53:33.157 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T20:53:43.173 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T20:53:53.190 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T20:54:03.215 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 1)... 2020-04-11T20:54:13.235 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T20:54:23.253 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T20:54:33.271 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T20:54:43.286 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T20:54:53.302 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T20:55:03.318 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T20:55:13.337 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T20:55:23.354 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T20:55:33.369 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T20:55:43.385 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T20:55:53.402 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T20:56:03.417 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T20:56:13.434 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T20:56:23.449 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T20:56:33.465 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T20:56:43.481 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T20:56:53.497 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T20:57:03.513 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 1)... 2020-04-11T20:57:13.528 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T20:57:23.545 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T20:57:33.561 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T20:57:43.580 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T20:57:53.593 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T20:58:03.609 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T20:58:13.625 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T20:58:23.641 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T20:58:33.657 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T20:58:43.675 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T20:58:53.693 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T20:59:03.709 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T20:59:13.725 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T20:59:23.741 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 2)... 2020-04-11T20:59:33.757 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 2)... 2020-04-11T20:59:43.767 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T20:59:53.788 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:00:03.807 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:00:13.822 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:00:23.839 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:00:33.860 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:00:43.879 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:00:53.897 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:01:03.913 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:01:13.930 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:01:23.945 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 2)... 2020-04-11T21:01:33.963 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 2)... 2020-04-11T21:01:43.977 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:01:53.993 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:02:04.009 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 2)... 2020-04-11T21:02:14.025 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 2)... 2020-04-11T21:02:24.041 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 2)... 2020-04-11T21:02:34.065 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 1)... 2020-04-11T21:02:44.081 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 1)... 2020-04-11T21:02:54.102 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:03:04.113 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:03:14.132 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:03:24.149 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:03:34.167 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:03:44.185 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:03:54.198 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:04:04.216 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:04:14.233 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:04:24.254 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:04:34.275 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:04:44.289 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:04:54.317 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:05:04.333 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:05:14.349 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:05:24.366 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:05:34.381 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:05:44.397 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:05:54.413 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:06:04.430 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 1)... 2020-04-11T21:06:14.448 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 1)... 2020-04-11T21:06:24.465 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 1)... 2020-04-11T21:06:34.481 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:06:44.501 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:06:54.510 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:07:04.525 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:07:14.541 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:07:24.558 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:07:34.576 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:07:44.594 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:07:54.613 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:08:04.629 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:08:14.647 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:08:24.665 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:08:34.674 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:08:44.689 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:08:54.715 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:09:04.729 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 1)... 2020-04-11T21:09:14.745 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:09:24.761 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 2)... 2020-04-11T21:09:34.782 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:09:44.791 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:09:54.805 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:10:04.821 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:10:14.839 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 1)... 2020-04-11T21:10:24.856 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 1)... 2020-04-11T21:10:34.877 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 1)... 2020-04-11T21:10:44.893 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:10:54.910 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:11:04.927 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:11:14.953 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 2)... 2020-04-11T21:11:24.969 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:11:34.986 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:11:45.007 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:11:55.017 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 1)... 2020-04-11T21:12:05.033 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:12:15.049 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 1)... 2020-04-11T21:12:25.072 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 1)... 2020-04-11T21:12:35.089 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:12:45.106 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:12:55.121 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:13:05.137 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:13:15.153 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:13:25.172 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 2)... 2020-04-11T21:13:35.199 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:13:45.217 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:13:55.233 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:14:05.246 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 2)... 2020-04-11T21:14:15.261 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:14:25.278 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:14:35.294 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:14:45.310 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 3)... 2020-04-11T21:14:55.331 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:15:05.348 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 1)... 2020-04-11T21:15:15.363 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 3)... 2020-04-11T21:15:25.381 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 2)... 2020-04-11T21:15:35.397 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:15:45.428 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:15:55.441 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:16:05.458 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:16:15.473 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:16:25.492 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:16:35.509 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:16:45.525 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:16:55.543 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 1)... 2020-04-11T21:17:05.559 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 1)... 2020-04-11T21:17:15.579 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 1)... 2020-04-11T21:17:25.598 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 1)... 2020-04-11T21:17:35.615 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 1)... 2020-04-11T21:17:45.629 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 2)... 2020-04-11T21:17:55.645 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:18:05.661 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:18:15.681 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:18:25.701 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:18:35.722 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:18:45.738 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:18:55.791 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:19:05.812 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 2)... 2020-04-11T21:19:15.828 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:19:25.845 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:19:35.861 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:19:45.885 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:19:55.901 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 2)... 2020-04-11T21:20:05.918 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:20:15.936 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:20:25.953 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:20:35.969 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:20:45.985 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:20:56.001 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:21:06.021 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 2)... 2020-04-11T21:21:16.038 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:21:26.053 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:21:36.069 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:21:46.086 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:21:56.102 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:22:06.111 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:22:16.127 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:22:26.142 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:22:36.161 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 1)... 2020-04-11T21:22:46.172 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:22:56.193 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:23:06.224 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:23:16.255 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:23:26.271 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 3)... 2020-04-11T21:23:36.290 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 1)... 2020-04-11T21:23:46.309 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:23:56.330 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:24:06.349 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:24:16.364 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:24:26.384 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:24:36.407 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 3)... 2020-04-11T21:24:46.421 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 3)... 2020-04-11T21:24:56.439 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 1)... 2020-04-11T21:25:06.458 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:25:16.476 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:25:26.500 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:25:36.526 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:25:46.542 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:25:56.557 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:26:06.580 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:26:16.597 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:26:26.613 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:26:36.639 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:26:46.681 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:26:56.707 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:27:06.731 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:27:16.743 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:27:26.762 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:27:36.783 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:27:46.878 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:27:56.895 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:28:06.915 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:28:16.929 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:28:26.952 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:28:36.972 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 1)... 2020-04-11T21:28:46.992 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:28:57.021 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:29:07.040 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:29:17.059 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:29:27.077 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:29:37.094 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:29:47.112 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:29:57.129 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:30:07.144 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:30:17.164 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:30:27.181 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:30:37.197 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:30:47.221 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 2)... 2020-04-11T21:30:57.241 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:31:07.263 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 1)... 2020-04-11T21:31:17.296 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:31:27.324 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:31:37.343 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:31:47.363 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:31:57.406 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:32:07.417 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:32:17.433 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:32:27.451 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 1)... 2020-04-11T21:32:37.560 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:32:47.580 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:32:57.598 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:33:07.616 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:33:17.634 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:33:27.649 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:33:37.668 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:33:47.685 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:33:57.701 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:34:07.716 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:34:17.733 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 1)... 2020-04-11T21:34:27.751 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:34:37.770 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:34:47.785 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:34:57.803 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 1)... 2020-04-11T21:35:07.820 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:35:17.839 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:35:27.858 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:35:37.882 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:35:47.901 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:35:57.920 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:36:07.929 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 2)... 2020-04-11T21:36:17.962 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:36:27.977 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:36:37.993 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:36:48.009 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:36:58.025 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:37:08.062 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:37:18.079 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:37:28.098 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:37:38.113 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 4)... 2020-04-11T21:37:48.130 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:37:58.148 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:38:08.166 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:38:18.182 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 1)... 2020-04-11T21:38:28.198 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 1)... 2020-04-11T21:38:38.214 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 1)... 2020-04-11T21:38:48.228 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 1)... 2020-04-11T21:38:58.244 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:39:08.261 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:39:18.287 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 1)... 2020-04-11T21:39:28.306 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:39:38.321 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:39:48.331 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 1)... 2020-04-11T21:39:58.349 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:40:08.373 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 3)... 2020-04-11T21:40:18.389 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 2)... 2020-04-11T21:40:28.408 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 2)... 2020-04-11T21:40:38.426 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 2)... 2020-04-11T21:40:48.441 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 3)... 2020-04-11T21:40:58.473 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:41:08.489 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 3)... 2020-04-11T21:41:18.505 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:41:28.523 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:41:38.541 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:41:48.559 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:41:58.588 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:42:08.605 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 2)... 2020-04-11T21:42:18.622 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:42:28.633 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:42:38.655 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 1)... 2020-04-11T21:42:48.668 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 1)... 2020-04-11T21:42:58.684 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 1)... 2020-04-11T21:43:08.697 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:43:18.714 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:43:28.730 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:43:38.747 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:43:48.765 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:43:58.781 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:44:08.794 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:44:18.809 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:44:28.827 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:44:38.843 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:44:48.857 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:44:58.884 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:45:08.903 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:45:18.917 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:45:28.934 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:45:38.951 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:45:48.969 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:45:58.986 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 1)... 2020-04-11T21:46:09.001 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:46:19.017 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:46:29.033 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:46:39.043 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)... 2020-04-11T21:46:49.060 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)...