2020-02-17T16:47:01.040 INFO:root:teuthology version: 1.0.0-7f4dc17 2020-02-17T16:47:01.041 DEBUG:teuthology.run:Teuthology command: teuthology /tmp/teuthology-worker.BNUnWX.tmp -- --verbose --lock --description rados:monthrash/{ceph.yaml clusters/9-mons.yaml mon_election/connectivity.yaml msgr-failures/mon-delay.yaml msgr/async-v2only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{centos_8.yaml} thrashers/one.yaml workloads/snaps-few-objects.yaml} --name gregf-2020-02-17_05:30:48-rados:monthrash-wip-elector-squash-212-distro-basic-mira --block --owner scheduled_gregf@teuthology --archive /home/teuthworker/archive/gregf-2020-02-17_05:30:48-rados:monthrash-wip-elector-squash-212-distro-basic-mira/4774534 2020-02-17T16:47:01.073 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-02-17T16:47:01.138 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/gregf-2020-02-17_05:30:48-rados:monthrash-wip-elector-squash-212-distro-basic-mira/4774534 branch: wip-elector-squash-212 description: rados:monthrash/{ceph.yaml clusters/9-mons.yaml mon_election/connectivity.yaml msgr-failures/mon-delay.yaml msgr/async-v2only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{centos_8.yaml} thrashers/one.yaml workloads/snaps-few-objects.yaml} email: gfarnum@redhat.com first_in_suite: false job_id: '4774534' kernel: kdb: true sha1: distro last_in_suite: false machine_type: mira name: gregf-2020-02-17_05:30:48-rados:monthrash-wip-elector-squash-212-distro-basic-mira nuke-on-error: true openstack: - volumes: count: 3 size: 10 os_type: centos os_version: '8.0' overrides: admin_socket: branch: wip-elector-squash-212 ceph: conf: global: mon client directed command retry: 5 mon election default strategy: 3 ms bind msgr1: false ms bind msgr2: true ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: mon ms inject internal delays: 0.002 ms inject socket failures: 2500 ms type: async mgr: debug monc: 10 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 25 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 paxos service trim min: 5 osd: debug filestore: 20 debug journal: 20 debug ms: 1 debug osd: 25 osd debug verify cached snaps: true osd debug verify missing on start: true osd objectstore: filestore osd op queue: debug_random osd op queue cut off: debug_random osd sloppy crc: true fs: xfs log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(MGR_DOWN\) - \(PG_AVAILABILITY\) - \(SLOW_OPS\) - \(OSD_SLOW_PING_TIME - overall HEALTH_ - \(MON_DOWN\) sha1: 4e96f6d01c87d23d720091cfdaa0900b92d41fab ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: osd objectstore: filestore osd sloppy crc: true filestore: true fs: xfs install: ceph: sha1: 4e96f6d01c87d23d720091cfdaa0900b92d41fab workunit: branch: wip-elector-qa sha1: 620894dc894e35d055c06b84b6a83bb6db81b626 owner: scheduled_gregf@teuthology priority: 101 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.b - mon.c - mon.d - mon.e - osd.0 - osd.1 - osd.2 - - mon.f - mon.g - mon.h - mon.i - mgr.x - osd.3 - osd.4 - osd.5 - client.0 sha1: 4e96f6d01c87d23d720091cfdaa0900b92d41fab suite: rados:monthrash suite_branch: wip-elector-qa suite_path: /home/teuthworker/src/github.com_gregsfortytwo_ceph_wip-elector-qa/qa suite_relpath: qa suite_repo: https://github.com/gregsfortytwo/ceph.git suite_sha1: 620894dc894e35d055c06b84b6a83bb6db81b626 tasks: - install: null - ceph: null - mon_thrash: revive_delay: 20 thrash_delay: 1 - rados: clients: - client.0 objects: 50 op_weights: copy_from: 50 delete: 50 read: 100 rollback: 50 snap_create: 50 snap_remove: 50 write: 100 ops: 4000 teuthology_branch: master tube: mira verbose: false worker_log: /home/teuthworker/archive/worker_logs/worker.mira.10670 2020-02-17T16:47:01.138 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_gregsfortytwo_ceph_wip-elector-qa/qa; will attempt to use it 2020-02-17T16:47:01.138 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_gregsfortytwo_ceph_wip-elector-qa/qa/tasks 2020-02-17T16:47:01.139 INFO:teuthology.run_tasks:Running task internal.check_packages... 2020-02-17T16:47:01.140 INFO:teuthology.task.internal:Checking packages... 2020-02-17T16:47:01.153 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'basic' and ceph hash '4e96f6d01c87d23d720091cfdaa0900b92d41fab' 2020-02-17T16:47:01.154 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-02-17T16:47:01.154 INFO:teuthology.packaging:ref: None 2020-02-17T16:47:01.154 INFO:teuthology.packaging:tag: None 2020-02-17T16:47:01.154 INFO:teuthology.packaging:branch: wip-elector-squash-212 2020-02-17T16:47:01.154 INFO:teuthology.packaging:sha1: 4e96f6d01c87d23d720091cfdaa0900b92d41fab 2020-02-17T16:47:01.154 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-elector-squash-212 2020-02-17T16:47:01.330 INFO:teuthology.task.internal:Found packages for ceph version 15.1.0-348.g4e96f6d 2020-02-17T16:47:01.331 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2020-02-17T16:47:01.339 INFO:teuthology.task.internal:no buildpackages task found 2020-02-17T16:47:01.339 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2020-02-17T16:47:01.353 INFO:teuthology.task.internal.lock_machines:Locking machines... 2020-02-17T16:47:01.353 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-02-17T16:47:01.415 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:47:11.432 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:47:21.451 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:47:31.494 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:47:41.520 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:47:51.540 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:48:01.559 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:48:11.578 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:48:21.598 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:48:31.615 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:48:41.631 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:48:51.646 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:49:01.662 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:49:11.679 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:49:21.706 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:49:31.717 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:49:41.735 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:49:51.753 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:50:01.772 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:50:11.790 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:50:21.807 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:50:31.825 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:50:41.846 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:50:51.864 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:51:01.875 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:51:11.891 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:51:21.909 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:51:31.928 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:51:41.946 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:51:51.959 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:52:01.975 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:52:11.991 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:52:22.008 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:52:32.026 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:52:42.044 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:52:52.060 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:53:02.083 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:53:12.099 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:53:22.116 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:53:32.133 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:53:42.152 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:53:52.170 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:54:02.187 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:54:12.207 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:54:22.224 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:54:32.239 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:54:42.254 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:54:52.273 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:55:02.292 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:55:12.307 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:55:22.322 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:55:32.347 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:55:42.365 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:55:52.384 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:56:02.399 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:56:12.415 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:56:22.434 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:56:32.452 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:56:42.476 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:56:52.494 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:57:02.508 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:57:12.533 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:57:22.551 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:57:32.566 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:57:42.586 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:57:52.604 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:58:02.635 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:58:12.645 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:58:22.662 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:58:32.678 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:58:42.697 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:58:52.717 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:59:02.734 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:59:12.752 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:59:22.773 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:59:32.792 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:59:42.811 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:59:52.826 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:00:02.843 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:00:12.862 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:00:22.919 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:00:32.935 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:00:42.950 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:00:52.969 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:01:02.986 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:01:13.003 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:01:23.020 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:01:33.039 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:01:43.059 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:01:53.074 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:02:03.090 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:02:13.107 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:02:23.124 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:02:33.148 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:02:43.174 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:02:53.193 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:03:03.211 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:03:13.226 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:03:23.250 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:03:33.267 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:03:43.287 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:03:53.302 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:04:03.321 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:04:13.342 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:04:23.359 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:04:33.388 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:04:43.408 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:04:53.427 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:05:03.443 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:05:13.460 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:05:23.475 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:05:33.495 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:05:43.514 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:05:53.533 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:06:03.550 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:06:13.567 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:06:23.586 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:06:33.604 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:06:43.623 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:06:53.640 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:07:03.658 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:07:13.680 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:07:23.698 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:07:33.710 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:07:43.733 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:07:53.751 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:08:03.768 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:08:13.785 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:08:23.804 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:08:33.823 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:08:43.839 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:08:53.867 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:09:03.883 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:09:13.894 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 3)... 2020-02-17T17:09:23.913 DEBUG:teuthology.lock.ops:lock_many request: {'count': 2, 'locked_by': 'scheduled_gregf@teuthology', 'description': '/home/teuthworker/archive/gregf-2020-02-17_05:30:48-rados:monthrash-wip-elector-squash-212-distro-basic-mira/4774534', 'machine_type': 'mira'} 2020-02-17T17:09:23.932 DEBUG:teuthology.lock.ops:locked ubuntu@mira088.front.sepia.ceph.com, ubuntu@mira057.front.sepia.ceph.com 2020-02-17T17:09:24.002 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2020-02-17T17:09:24.216 INFO:teuthology.provision.fog.mira057:Scheduling deploy of centos 8.0 2020-02-17T17:09:24.244 INFO:teuthology.provision.fog.mira088:Scheduling deploy of centos 8.0 2020-02-17T17:09:24.738 INFO:teuthology.orchestra.console:Power off mira057 2020-02-17T17:09:24.739 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H mira057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-02-17T17:09:24.761 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H mira057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-17T17:09:24.816 INFO:teuthology.orchestra.console:Power off mira088 2020-02-17T17:09:24.816 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H mira088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-02-17T17:09:24.852 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H mira088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-17T17:09:24.895 INFO:teuthology.orchestra.console:Power off for mira057 completed 2020-02-17T17:09:24.980 INFO:teuthology.orchestra.console:Power off for mira088 completed 2020-02-17T17:09:24.996 INFO:teuthology.orchestra.console:Power on mira057 2020-02-17T17:09:24.996 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H mira057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-02-17T17:09:25.021 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H mira057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-17T17:09:25.081 INFO:teuthology.orchestra.console:Power on mira088 2020-02-17T17:09:25.082 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H mira088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-02-17T17:09:25.108 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H mira088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-17T17:09:29.050 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H mira057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-17T17:09:29.160 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H mira088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-17T17:09:33.162 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H mira057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-17T17:09:33.271 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H mira088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-17T17:09:33.371 INFO:teuthology.orchestra.console:Power on for mira057 completed 2020-02-17T17:09:33.472 INFO:teuthology.provision.fog.mira057:Waiting for deploy to finish 2020-02-17T17:09:33.483 INFO:teuthology.orchestra.console:Power on for mira088 completed 2020-02-17T17:09:33.583 INFO:teuthology.provision.fog.mira088:Waiting for deploy to finish 2020-02-17T17:12:24.612 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2020-02-17T17:12:24.613 DEBUG:teuthology.task.console_log:Killing console logger for mira057 2020-02-17T17:12:24.613 DEBUG:teuthology.task.console_log:Killing console logger for mira088 2020-02-17T17:12:24.614 DEBUG:teuthology.exit:Finished running handlers