2021-01-26T16:36:37.129 INFO:root:teuthology version: 1.0.0-fe79ba1b 2021-01-26T16:36:37.132 DEBUG:teuthology.run:Teuthology command: teuthology --name teuthology-2021-01-25_02:01:03-rbd-master-distro-basic-gibba --description rbd/qemu/{cache/writearound clusters/{fixed-3 openstack} features/readbalance msgr-failures/few objectstore/bluestore-hybrid pool/ec-cache-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_xfstests} --verbose --lock --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2021-01-25_02:01:03-rbd-master-distro-basic-gibba/5823537 --block -- /tmp/teuthology-worker.7qmnknfr.tmp 2021-01-26T16:36:37.169 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-01-26T16:36:37.240 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2021-01-25_02:01:03-rbd-master-distro-basic-gibba/5823537 branch: master description: rbd/qemu/{cache/writearound clusters/{fixed-3 openstack} features/readbalance msgr-failures/few objectstore/bluestore-hybrid pool/ec-cache-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_xfstests} email: ceph-qa@ceph.io exclude_arch: armv7l first_in_suite: false job_id: '5823537' kernel: kdb: true sha1: distro last_in_suite: false machine_type: gibba name: teuthology-2021-01-25_02:01:03-rbd-master-distro-basic-gibba nuke-on-error: true openstack: - volumes: count: 4 size: 10 - machine: cpus: 1 disk: 40 ram: 30000 volumes: count: 4 size: 30 os_type: ubuntu os_version: '18.04' overrides: admin_socket: branch: master ceph: conf: client: rbd read from replica policy: balance global: mon client directed command retry: 5 ms inject socket failures: 5000 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bluefs allocator: hybrid bluestore allocator: hybrid bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug filestore: 20 debug journal: 20 debug ms: 20 debug osd: 25 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - but it is still running - \(OSD_SLOW_PING_TIME - overall HEALTH_ - \(CACHE_POOL_NEAR_FULL\) - \(CACHE_POOL_NO_HIT_SET\) log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 70828cb1a8014f8c92cf86014114fd7aab6861c9 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: sha1: 70828cb1a8014f8c92cf86014114fd7aab6861c9 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: master sha1: 70828cb1a8014f8c92cf86014114fd7aab6861c9 owner: scheduled_teuthology@teuthology priority: 80 repo: git://git.ceph.com/ceph.git roles: - - mon.a - mon.c - mgr.x - osd.0 - osd.1 - osd.2 - osd.3 - - mon.b - mgr.y - osd.4 - osd.5 - osd.6 - osd.7 - - client.0 sha1: 70828cb1a8014f8c92cf86014114fd7aab6861c9 sleep_before_teardown: 0 suite: rbd suite_branch: master suite_path: /home/teuthworker/src/git.ceph.com_ceph_master/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph.git suite_sha1: 70828cb1a8014f8c92cf86014114fd7aab6861c9 tasks: - install: null - ceph: conf: client: rbd cache: true rbd cache policy: writearound - exec: osd.0: - ceph osd require-osd-release pacific - ceph osd set-require-min-compat-client octopus - exec: client.0: - sudo ceph osd erasure-code-profile set teuthologyprofile crush-failure-domain=osd m=1 k=2 - sudo ceph osd pool delete rbd rbd --yes-i-really-really-mean-it - sudo ceph osd pool create rbd 4 4 erasure teuthologyprofile - sudo ceph osd pool create cache 4 - sudo ceph osd tier add rbd cache - sudo ceph osd tier cache-mode cache writeback - sudo ceph osd tier set-overlay rbd cache - sudo ceph osd pool set cache hit_set_type bloom - sudo ceph osd pool set cache hit_set_count 8 - sudo ceph osd pool set cache hit_set_period 60 - sudo ceph osd pool set cache target_max_objects 250 - rbd pool init rbd - qemu: all: clone: true disks: 3 test: qa/run_xfstests_qemu.sh type: block teuthology_branch: master timestamp: 2021-01-25_02:01:03 tube: gibba user: teuthology verbose: true worker_log: /home/teuthworker/archive/worker_logs/worker.gibba.9465 2021-01-26T16:36:37.241 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_master/qa; will attempt to use it 2021-01-26T16:36:37.245 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_master/qa/tasks 2021-01-26T16:36:37.246 INFO:teuthology.run_tasks:Running task internal.check_packages... 2021-01-26T16:36:37.248 INFO:teuthology.task.internal:Checking packages... 2021-01-26T16:36:37.297 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'basic' and ceph hash '70828cb1a8014f8c92cf86014114fd7aab6861c9' 2021-01-26T16:36:37.298 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-01-26T16:36:37.298 INFO:teuthology.packaging:ref: None 2021-01-26T16:36:37.299 INFO:teuthology.packaging:tag: None 2021-01-26T16:36:37.299 INFO:teuthology.packaging:branch: master 2021-01-26T16:36:37.299 INFO:teuthology.packaging:sha1: 70828cb1a8014f8c92cf86014114fd7aab6861c9 2021-01-26T16:36:37.300 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&ref=master 2021-01-26T16:36:38.225 INFO:teuthology.task.internal:Found packages for ceph version 17.0.0-93-gff0a0628-1bionic 2021-01-26T16:36:38.226 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2021-01-26T16:36:38.243 INFO:teuthology.task.internal:no buildpackages task found 2021-01-26T16:36:38.243 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2021-01-26T16:36:38.277 INFO:teuthology.task.internal.lock_machines:Locking machines... 2021-01-26T16:36:38.279 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-01-26T16:36:38.329 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:36:48.347 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:36:58.363 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:37:08.380 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:37:18.398 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:37:28.415 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:37:38.435 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:37:48.449 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:37:58.468 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:38:08.482 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:38:18.499 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:38:28.514 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:38:38.532 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:38:48.545 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:38:58.562 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:39:08.579 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:39:18.597 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:39:28.616 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:39:38.632 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:39:48.671 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:39:58.688 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:40:08.706 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:40:18.723 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:40:28.737 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:40:38.756 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:40:48.781 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:40:58.798 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:41:08.815 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:41:18.831 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:41:28.850 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:41:38.869 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:41:48.886 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:41:58.903 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:42:08.919 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:42:18.941 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:42:28.958 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:42:38.977 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:42:48.995 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:42:59.011 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:43:09.031 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:43:19.048 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:43:29.064 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:43:39.084 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:43:49.105 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:43:59.124 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:44:09.144 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:44:19.372 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:44:29.387 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:44:39.404 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:44:49.421 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:44:59.443 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:45:09.460 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:45:19.478 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:45:29.497 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:45:39.516 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:45:49.531 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:45:59.548 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:46:09.571 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:46:19.587 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:46:29.603 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:46:39.618 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:46:49.635 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:46:59.651 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:47:09.667 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:47:19.683 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:47:29.699 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:47:39.716 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:47:49.733 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:47:59.750 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:48:09.768 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:48:19.787 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:48:29.802 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:48:39.819 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:48:49.835 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:48:59.852 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:49:09.870 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:49:19.888 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:49:29.907 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:49:39.924 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:49:49.939 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:49:59.956 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:50:09.967 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:50:19.983 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:50:30.001 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:50:40.037 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:50:50.055 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:51:00.073 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:51:10.092 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:51:20.107 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 2)... 2021-01-26T16:51:30.128 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 0)... 2021-01-26T16:51:40.145 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 0)... 2021-01-26T16:51:50.163 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 0)... 2021-01-26T16:52:00.179 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 0)... 2021-01-26T16:52:10.194 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 0)... 2021-01-26T16:52:20.212 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 0)... 2021-01-26T16:52:30.230 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 0)... 2021-01-26T16:52:40.247 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 0)... 2021-01-26T16:52:50.265 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 0)... 2021-01-26T16:53:00.274 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 0)... 2021-01-26T16:53:10.291 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 0)... 2021-01-26T16:53:20.308 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 0)... 2021-01-26T16:53:30.323 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 0)... 2021-01-26T16:53:40.342 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 0)... 2021-01-26T16:53:50.360 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 0)... 2021-01-26T16:54:00.378 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 0)... 2021-01-26T16:54:10.395 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 0)... 2021-01-26T16:54:20.414 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 0)... 2021-01-26T16:54:30.430 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 0)... 2021-01-26T16:54:40.466 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 0)... 2021-01-26T16:54:50.478 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 0)... 2021-01-26T16:55:00.493 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 0)... 2021-01-26T16:55:10.511 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 0)... 2021-01-26T16:55:20.527 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 0)... 2021-01-26T16:55:30.549 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 0)... 2021-01-26T16:55:40.567 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 0)... 2021-01-26T16:55:50.580 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 0)... 2021-01-26T16:56:00.599 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 0)... 2021-01-26T16:56:10.614 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 0)... 2021-01-26T16:56:20.631 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 0)... 2021-01-26T16:56:30.655 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 0)... 2021-01-26T16:56:40.665 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 0)... 2021-01-26T16:56:50.683 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 0)... 2021-01-26T16:57:00.699 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 0)... 2021-01-26T16:57:10.709 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 0)... 2021-01-26T16:57:20.729 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 0)... 2021-01-26T16:57:30.747 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 0)... 2021-01-26T16:57:40.762 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 0)... 2021-01-26T16:57:50.781 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 0)... 2021-01-26T16:58:00.800 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 0)... 2021-01-26T16:58:10.812 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 0)... 2021-01-26T16:58:20.834 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 0)... 2021-01-26T16:58:30.861 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 0)... 2021-01-26T16:58:40.879 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 0)... 2021-01-26T16:58:50.894 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 0)... 2021-01-26T16:59:00.911 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 0)... 2021-01-26T16:59:10.929 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 0)... 2021-01-26T16:59:20.947 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 0)... 2021-01-26T16:59:30.963 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 0)... 2021-01-26T16:59:40.981 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 0)... 2021-01-26T16:59:51.004 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 0)... 2021-01-26T17:00:01.017 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 0)... 2021-01-26T17:00:11.035 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 0)... 2021-01-26T17:00:21.046 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 0)... 2021-01-26T17:00:31.062 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 0)... 2021-01-26T17:00:41.077 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 0)... 2021-01-26T17:00:51.096 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 0)... 2021-01-26T17:01:01.114 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 0)... 2021-01-26T17:01:11.135 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 0)... 2021-01-26T17:01:21.154 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 0)... 2021-01-26T17:01:31.173 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 1)... 2021-01-26T17:01:41.191 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 1)... 2021-01-26T17:01:51.207 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 1)... 2021-01-26T17:02:01.233 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 1)... 2021-01-26T17:02:11.252 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 1)... 2021-01-26T17:02:21.272 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 1)... 2021-01-26T17:02:31.290 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 1)... 2021-01-26T17:02:41.308 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 1)... 2021-01-26T17:02:51.323 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 1)... 2021-01-26T17:03:01.353 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 1)... 2021-01-26T17:03:11.370 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 1)... 2021-01-26T17:03:21.401 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 1)... 2021-01-26T17:03:31.422 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 1)... 2021-01-26T17:03:41.440 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 1)... 2021-01-26T17:03:51.455 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 1)... 2021-01-26T17:04:01.471 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 1)... 2021-01-26T17:04:11.487 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 1)... 2021-01-26T17:04:21.505 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 1)... 2021-01-26T17:04:31.543 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 1)... 2021-01-26T17:04:41.562 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 1)... 2021-01-26T17:04:51.582 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 1)... 2021-01-26T17:05:01.598 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 1)... 2021-01-26T17:05:11.617 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 1)... 2021-01-26T17:05:21.636 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 1)... 2021-01-26T17:05:31.657 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 1)... 2021-01-26T17:05:41.676 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 1)... 2021-01-26T17:05:51.692 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 1)... 2021-01-26T17:06:01.712 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 1)... 2021-01-26T17:06:11.727 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 1)... 2021-01-26T17:06:21.737 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 1)... 2021-01-26T17:06:31.752 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 1)... 2021-01-26T17:06:41.769 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 1)... 2021-01-26T17:06:51.789 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 1)... 2021-01-26T17:07:01.810 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 1)... 2021-01-26T17:07:11.827 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 1)... 2021-01-26T17:07:21.844 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 1)... 2021-01-26T17:07:31.861 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 1)... 2021-01-26T17:07:41.895 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 1)... 2021-01-26T17:07:51.915 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 1)... 2021-01-26T17:08:01.936 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 1)... 2021-01-26T17:08:11.956 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 1)... 2021-01-26T17:08:21.971 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 1)... 2021-01-26T17:08:31.987 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 1)... 2021-01-26T17:08:42.005 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 1)... 2021-01-26T17:08:52.066 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 1)... 2021-01-26T17:09:02.092 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 1)... 2021-01-26T17:09:12.107 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 1)... 2021-01-26T17:09:22.122 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 1)... 2021-01-26T17:09:32.140 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 1)... 2021-01-26T17:09:42.162 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 1)... 2021-01-26T17:09:52.180 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 1)... 2021-01-26T17:10:02.195 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 1)... 2021-01-26T17:10:12.212 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 1)... 2021-01-26T17:10:22.229 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 1)... 2021-01-26T17:10:32.248 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 1)... 2021-01-26T17:10:42.263 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 1)... 2021-01-26T17:10:52.280 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 1)... 2021-01-26T17:11:02.295 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 1)... 2021-01-26T17:11:12.312 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 1)... 2021-01-26T17:11:22.334 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 1)... 2021-01-26T17:11:32.352 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 1)... 2021-01-26T17:11:42.366 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 1)... 2021-01-26T17:11:52.383 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 1)... 2021-01-26T17:12:02.400 INFO:teuthology.task.internal.lock_machines:waiting for more gibba machines to be free (need 0 + 3, have 1)...