2020-03-27T18:02:31.133 INFO:root:teuthology version: 1.0.0-b3a6b1a
2020-03-27T18:02:31.134 DEBUG:teuthology.run:Teuthology command: teuthology /tmp/teuthology-worker.wGDqL6.tmp -- --verbose --lock --description rados:thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-install/nautilus.yaml backoff/normal.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/off.yaml distro$/{centos_7.6.yaml} msgr-failures/few.yaml rados.yaml thrashers/none.yaml thrashosds-health.yaml workloads/radosbench.yaml} --name sage-2020-03-27_17:51:50-rados:thrash-old-clients-revert-dec-distro-basic-smithi --block --owner scheduled_sage@teuthology --archive /home/teuthworker/archive/sage-2020-03-27_17:51:50-rados:thrash-old-clients-revert-dec-distro-basic-smithi/4895627
2020-03-27T18:02:31.170 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/
2020-03-27T18:02:31.226 INFO:teuthology.run:Config:
  archive_path: /home/teuthworker/archive/sage-2020-03-27_17:51:50-rados:thrash-old-clients-revert-dec-distro-basic-smithi/4895627
  branch: revert-dec
  description: rados:thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size.yaml
    1-install/nautilus.yaml backoff/normal.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml}
    d-balancer/off.yaml distro$/{centos_7.6.yaml} msgr-failures/few.yaml rados.yaml
    thrashers/none.yaml thrashosds-health.yaml workloads/radosbench.yaml}
  email: null
  first_in_suite: false
  job_id: '4895627'
  kernel:
    kdb: true
    sha1: distro
  last_in_suite: false
  machine_type: smithi
  name: sage-2020-03-27_17:51:50-rados:thrash-old-clients-revert-dec-distro-basic-smithi
  nuke-on-error: true
  openstack:
  - volumes:
      count: 4
      size: 30
  - volumes:
      count: 4
      size: 10
  os_type: centos
  os_version: '7.6'
  overrides:
    admin_socket:
      branch: revert-dec
    ceph:
      conf:
        client.2:
          debug ms: 1
          debug objecter: 20
          debug rados: 20
        global:
          mon client directed command retry: 5
          ms inject socket failures: 5000
          osd_pool_default_min_size: 2
          osd_pool_default_size: 3
        mgr:
          debug mgr: 20
          debug ms: 1
        mon:
          debug mon: 20
          debug ms: 1
          debug paxos: 20
        osd:
          debug filestore: 20
          debug journal: 20
          debug ms: 20
          debug osd: 25
          osd debug verify cached snaps: true
          osd debug verify missing on start: true
          osd heartbeat use min delay socket: true
          osd max markdown count: 1000
          osd op queue: debug_random
          osd op queue cut off: debug_random
          osd shutdown pgref assert: true
      log-whitelist:
      - \(MDS_ALL_DOWN\)
      - \(MDS_UP_LESS_THAN_MAX\)
      - \(MON_DOWN\)
      - \(OSD_SLOW_PING_TIME
      - overall HEALTH_
      - \(OSDMAP_FLAGS\)
      - \(OSD_
      - \(PG_
      - \(POOL_
      - \(CACHE_POOL_
      - \(SMALLER_PGP_NUM\)
      - \(OBJECT_
      - \(SLOW_OPS\)
      - \(REQUEST_SLOW\)
      - \(TOO_FEW_PGS\)
      - slow request
      sha1: df873c1654814c23dcb68f897a012936832bfab9
    ceph-deploy:
      conf:
        client:
          log file: /var/log/ceph/ceph-$name.$pid.log
        mon:
          osd default pool size: 2
    install:
      ceph:
        sha1: df873c1654814c23dcb68f897a012936832bfab9
    selinux:
      whitelist:
      - scontext=system_u:system_r:logrotate_t:s0
    thrashosds:
      min_in: 4
    workunit:
      branch: revert-dec
      sha1: df873c1654814c23dcb68f897a012936832bfab9
  owner: scheduled_sage@teuthology
  priority: 50
  repo: git://git.ceph.com/ceph-ci.git
  roles:
  - - mon.a
    - mgr.y
    - osd.0
    - osd.1
    - osd.2
    - osd.3
    - client.0
  - - mon.b
    - mgr.x
    - osd.4
    - osd.5
    - osd.6
    - osd.7
    - client.1
  - - mon.c
    - osd.8
    - osd.9
    - osd.10
    - osd.11
    - client.2
  sha1: df873c1654814c23dcb68f897a012936832bfab9
  suite: rados:thrash-old-clients
  suite_branch: revert-dec
  suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_revert-dec/qa
  suite_relpath: qa
  suite_repo: git://git.ceph.com/ceph-ci.git
  suite_sha1: df873c1654814c23dcb68f897a012936832bfab9
  tasks:
  - install:
      branch: nautilus
      exclude_packages:
      - cephadm
      - ceph-mgr-cephadm
      - ceph-immutable-object-cache
      - python3-rados
      - python3-rgw
      - python3-rbd
      - python3-cephfs
      extra_packages:
      - python-rados
      - python-rgw
      - python-rbd
      - python-cephfs
  - cephadm: null
  - full_sequential:
    - radosbench:
        clients:
        - client.2
        time: 90
    - radosbench:
        clients:
        - client.2
        time: 90
    - radosbench:
        clients:
        - client.2
        time: 90
    - radosbench:
        clients:
        - client.2
        time: 90
    - radosbench:
        clients:
        - client.2
        time: 90
    - radosbench:
        clients:
        - client.2
        time: 90
    - radosbench:
        clients:
        - client.2
        time: 90
    - radosbench:
        clients:
        - client.2
        time: 90
  teuthology_branch: master
  tube: smithi
  verbose: false
  worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.2405
2020-03-27T18:02:31.226 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_revert-dec/qa; will attempt to use it
2020-03-27T18:02:31.226 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_revert-dec/qa/tasks
2020-03-27T18:02:31.227 INFO:teuthology.run_tasks:Running task internal.check_packages...
2020-03-27T18:02:31.228 INFO:teuthology.task.internal:Checking packages...
2020-03-27T18:02:31.241 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'basic' and ceph hash 'df873c1654814c23dcb68f897a012936832bfab9'
2020-03-27T18:02:31.241 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch
2020-03-27T18:02:31.241 INFO:teuthology.packaging:ref: None
2020-03-27T18:02:31.241 INFO:teuthology.packaging:tag: None
2020-03-27T18:02:31.241 INFO:teuthology.packaging:branch: revert-dec
2020-03-27T18:02:31.241 INFO:teuthology.packaging:sha1: df873c1654814c23dcb68f897a012936832bfab9
2020-03-27T18:02:31.242 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F7%2Fx86_64&ref=revert-dec
2020-03-27T18:02:31.476 INFO:teuthology.task.internal:Found packages for ceph version 15.2.0-377.gdf873c1
2020-03-27T18:02:31.477 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep...
2020-03-27T18:02:31.484 INFO:teuthology.task.internal:no buildpackages task found
2020-03-27T18:02:31.484 INFO:teuthology.run_tasks:Running task internal.lock_machines...
2020-03-27T18:02:31.492 INFO:teuthology.task.internal.lock_machines:Locking machines...
2020-03-27T18:02:31.493 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/
2020-03-27T18:02:31.562 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:02:41.578 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:02:51.597 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:03:01.614 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:03:11.631 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:03:21.647 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:03:31.667 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:03:41.685 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:03:51.701 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:04:01.725 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:04:11.743 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:04:21.762 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:04:31.778 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:04:41.792 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:04:51.810 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:05:01.832 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:05:11.856 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:05:21.872 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:05:31.895 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:05:41.913 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:05:51.933 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:06:01.950 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:06:11.966 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:06:21.985 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:06:32.013 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:06:42.027 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:06:52.048 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:07:02.065 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:07:12.082 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)...
2020-03-27T18:07:22.105 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:07:32.121 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:07:42.135 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:07:52.153 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:08:02.179 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:08:12.196 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:08:22.212 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:08:32.226 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:08:42.241 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:08:52.254 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:09:02.271 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:09:12.288 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:09:22.301 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:09:32.320 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:09:42.341 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:09:52.357 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:10:02.377 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)...
2020-03-27T18:10:12.394 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)...
2020-03-27T18:10:22.417 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:10:32.433 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:10:42.448 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:10:52.464 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:11:02.486 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:11:12.502 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:11:22.517 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:11:32.533 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:11:42.551 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:11:52.569 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:12:02.586 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:12:12.605 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:12:22.622 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:12:32.636 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:12:42.652 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:12:52.672 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:13:02.689 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:13:12.706 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:13:22.721 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:13:32.737 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:13:42.755 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:13:52.773 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:14:02.792 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)...
2020-03-27T18:14:12.814 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:14:22.829 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:14:32.846 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:14:42.865 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:14:52.889 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:15:02.906 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:15:12.925 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:15:22.940 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:15:32.978 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:15:42.994 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:15:53.013 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:16:03.029 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:16:13.045 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:16:23.068 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:16:33.085 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:16:43.101 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:16:53.118 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:17:03.135 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:17:13.151 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:17:23.168 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:17:33.187 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:17:43.204 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:17:53.222 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:18:03.239 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:18:13.257 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:18:23.274 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:18:33.290 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:18:43.307 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:18:53.322 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:19:03.338 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:19:13.353 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:19:23.370 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:19:33.387 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:19:43.407 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:19:53.421 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:20:03.445 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:20:13.464 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:20:23.482 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:20:33.497 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:20:43.514 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:20:53.535 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:21:03.555 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:21:13.574 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:21:23.589 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:21:33.610 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:21:43.632 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:21:53.649 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:22:03.665 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:22:13.682 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:22:23.704 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:22:33.713 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:22:43.730 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:22:53.746 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:23:03.763 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:23:13.789 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:23:23.808 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:23:33.831 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:23:43.849 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:23:53.870 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:24:03.890 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:24:13.906 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:24:23.924 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 4)...
2020-03-27T18:24:33.942 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:24:43.957 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:24:53.974 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:25:03.989 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:25:14.006 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:25:24.022 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:25:34.038 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:25:44.055 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:25:54.064 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:26:04.075 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:26:14.094 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:26:24.111 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:26:34.128 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:26:44.145 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:26:54.162 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:27:04.178 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:27:14.197 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:27:24.213 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:27:34.238 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:27:44.255 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:27:54.272 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:28:04.289 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:28:14.305 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:28:24.321 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:28:34.338 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:28:44.355 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:28:54.387 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:29:04.397 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:29:14.418 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:29:24.437 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:29:34.453 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:29:44.471 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:29:54.494 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:30:04.512 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:30:14.543 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:30:24.561 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:30:34.577 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:30:44.595 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:30:54.609 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:31:04.629 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:31:14.644 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:31:24.660 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:31:34.683 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:31:44.693 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:31:54.708 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:32:04.725 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:32:14.742 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:32:24.758 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:32:34.775 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 0)...
2020-03-27T18:32:44.815 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:32:54.832 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:33:04.857 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:33:14.876 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:33:24.893 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:33:34.911 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:33:44.930 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:33:54.953 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:34:04.970 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 1)...
2020-03-27T18:34:14.998 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:34:25.017 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:34:35.034 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:34:45.050 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:34:55.069 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:35:05.089 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:35:15.110 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:35:25.126 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:35:35.145 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:35:45.163 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:35:55.177 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:36:05.194 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:36:15.214 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:36:25.252 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:36:35.299 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:36:45.310 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:36:55.329 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:37:05.346 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 3)...
2020-03-27T18:37:15.360 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:37:25.380 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:37:35.399 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:37:45.416 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:37:55.434 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:38:05.451 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:38:15.465 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:38:25.481 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:38:35.506 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:38:45.520 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:38:55.537 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:39:05.562 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...
2020-03-27T18:39:15.583 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 3, have 2)...