2020-02-17T16:38:57.515 INFO:root:teuthology version: 1.0.0-7f4dc17 2020-02-17T16:38:57.515 DEBUG:teuthology.run:Teuthology command: teuthology /tmp/teuthology-worker.uchm9T.tmp -- --verbose --lock --description rados:monthrash/{ceph.yaml clusters/9-mons.yaml mon_election/connectivity.yaml msgr-failures/mon-delay.yaml msgr/async.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/force-sync-many.yaml workloads/rados_mon_osdmap_prune.yaml} --name gregf-2020-02-17_05:30:48-rados:monthrash-wip-elector-squash-212-distro-basic-mira --block --owner scheduled_gregf@teuthology --archive /home/teuthworker/archive/gregf-2020-02-17_05:30:48-rados:monthrash-wip-elector-squash-212-distro-basic-mira/4774532 2020-02-17T16:38:57.555 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-02-17T16:38:57.612 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/gregf-2020-02-17_05:30:48-rados:monthrash-wip-elector-squash-212-distro-basic-mira/4774532 branch: wip-elector-squash-212 description: rados:monthrash/{ceph.yaml clusters/9-mons.yaml mon_election/connectivity.yaml msgr-failures/mon-delay.yaml msgr/async.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/force-sync-many.yaml workloads/rados_mon_osdmap_prune.yaml} email: gfarnum@redhat.com first_in_suite: false job_id: '4774532' kernel: kdb: true sha1: distro last_in_suite: false machine_type: mira name: gregf-2020-02-17_05:30:48-rados:monthrash-wip-elector-squash-212-distro-basic-mira nuke-on-error: true openstack: - volumes: count: 3 size: 10 os_type: ubuntu os_version: '18.04' overrides: admin_socket: branch: wip-elector-squash-212 ceph: conf: global: mon client directed command retry: 5 mon election default strategy: 3 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: mon ms inject internal delays: 0.002 ms inject socket failures: 2500 ms type: async mgr: debug monc: 10 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon debug extra checks: true mon min osdmap epochs: 100 mon osdmap full prune enabled: true mon osdmap full prune interval: 10 mon osdmap full prune min: 200 mon osdmap full prune txsize: 100 paxos service trim min: 5 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug filestore: 20 debug journal: 20 debug ms: 1 debug osd: 25 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd beacon report interval: 10 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd memory target: 1610612736 osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random fs: xfs log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(MGR_DOWN\) - \(PG_AVAILABILITY\) - \(SLOW_OPS\) - \(OSD_SLOW_PING_TIME - overall HEALTH_ - \(MON_DOWN\) - \(TOO_FEW_PGS\) - \(OSDMAP_FLAGS\) sha1: 4e96f6d01c87d23d720091cfdaa0900b92d41fab ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: sha1: 4e96f6d01c87d23d720091cfdaa0900b92d41fab thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-elector-qa sha1: 620894dc894e35d055c06b84b6a83bb6db81b626 owner: scheduled_gregf@teuthology priority: 101 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.b - mon.c - mon.d - mon.e - osd.0 - osd.1 - osd.2 - - mon.f - mon.g - mon.h - mon.i - mgr.x - osd.3 - osd.4 - osd.5 - client.0 sha1: 4e96f6d01c87d23d720091cfdaa0900b92d41fab suite: rados:monthrash suite_branch: wip-elector-qa suite_path: /home/teuthworker/src/github.com_gregsfortytwo_ceph_wip-elector-qa/qa suite_relpath: qa suite_repo: https://github.com/gregsfortytwo/ceph.git suite_sha1: 620894dc894e35d055c06b84b6a83bb6db81b626 tasks: - install: null - ceph: null - mon_thrash: revive_delay: 90 store_thrash: true thrash_delay: 1 thrash_many: true - workunit: clients: client.0: - mon/test_mon_osdmap_prune.sh teuthology_branch: master tube: mira verbose: false worker_log: /home/teuthworker/archive/worker_logs/worker.mira.10674 2020-02-17T16:38:57.613 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_gregsfortytwo_ceph_wip-elector-qa/qa; will attempt to use it 2020-02-17T16:38:57.613 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_gregsfortytwo_ceph_wip-elector-qa/qa/tasks 2020-02-17T16:38:57.613 INFO:teuthology.run_tasks:Running task internal.check_packages... 2020-02-17T16:38:57.619 INFO:teuthology.task.internal:Checking packages... 2020-02-17T16:38:57.632 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'basic' and ceph hash '4e96f6d01c87d23d720091cfdaa0900b92d41fab' 2020-02-17T16:38:57.632 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-02-17T16:38:57.632 INFO:teuthology.packaging:ref: None 2020-02-17T16:38:57.632 INFO:teuthology.packaging:tag: None 2020-02-17T16:38:57.632 INFO:teuthology.packaging:branch: wip-elector-squash-212 2020-02-17T16:38:57.632 INFO:teuthology.packaging:sha1: 4e96f6d01c87d23d720091cfdaa0900b92d41fab 2020-02-17T16:38:57.633 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&ref=wip-elector-squash-212 2020-02-17T16:38:57.786 INFO:teuthology.task.internal:Found packages for ceph version 15.1.0-348-g4e96f6d-1bionic 2020-02-17T16:38:57.786 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2020-02-17T16:38:57.795 INFO:teuthology.task.internal:no buildpackages task found 2020-02-17T16:38:57.795 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2020-02-17T16:38:57.804 INFO:teuthology.task.internal.lock_machines:Locking machines... 2020-02-17T16:38:57.804 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-02-17T16:38:57.850 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:39:07.866 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:39:17.883 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:39:27.899 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:39:37.914 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:39:47.936 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:39:57.956 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:40:07.978 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:40:17.998 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:40:28.017 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:40:38.042 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:40:48.059 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:40:58.076 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:41:08.091 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:41:18.106 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:41:28.125 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:41:38.144 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:41:48.158 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:41:58.176 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:42:08.189 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:42:18.206 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:42:28.223 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:42:38.243 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:42:48.257 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:42:58.292 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:43:08.311 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:43:18.328 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:43:28.345 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:43:38.364 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:43:48.382 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:43:58.399 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:44:08.416 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:44:18.436 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:44:28.450 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:44:38.467 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:44:48.486 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:44:58.503 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:45:08.521 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:45:18.539 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:45:28.557 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:45:38.574 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:45:48.599 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:45:58.616 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:46:08.635 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:46:18.651 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:46:28.666 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:46:38.689 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:46:48.708 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:46:58.730 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:47:08.754 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:47:18.772 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:47:28.789 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:47:38.807 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:47:48.823 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:47:58.841 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:48:08.858 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:48:18.875 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:48:28.891 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:48:38.907 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:48:48.930 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:48:58.947 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:49:08.964 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:49:18.982 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:49:29.001 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:49:39.018 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:49:49.036 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:49:59.051 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:50:09.069 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:50:19.086 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:50:29.097 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:50:39.117 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:50:49.135 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:50:59.153 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:51:09.178 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:51:19.198 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:51:29.213 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:51:39.226 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:51:49.236 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:51:59.255 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:52:09.270 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:52:19.290 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:52:29.308 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:52:39.327 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:52:49.343 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:52:59.359 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:53:09.376 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:53:19.394 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:53:29.412 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:53:39.428 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:53:49.446 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:53:59.463 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:54:09.481 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:54:19.498 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:54:29.515 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:54:39.532 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:54:49.548 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:54:59.563 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:55:09.574 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:55:19.591 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:55:29.611 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:55:39.628 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:55:49.647 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:55:59.664 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:56:09.683 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:56:19.700 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:56:29.715 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:56:39.734 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:56:49.752 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:56:59.770 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:57:09.787 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:57:19.807 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:57:29.822 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:57:39.841 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:57:49.858 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:57:59.876 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:58:09.891 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:58:19.906 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:58:29.922 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:58:39.938 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:58:49.956 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:58:59.972 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:59:09.991 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:59:20.006 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:59:30.024 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:59:40.039 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T16:59:50.058 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:00:00.077 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:00:10.095 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:00:20.111 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:00:30.130 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:00:40.163 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:00:50.178 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:01:00.195 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:01:10.211 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:01:20.225 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:01:30.246 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:01:40.269 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:01:50.287 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:02:00.302 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:02:10.317 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:02:20.338 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:02:30.354 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:02:40.371 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:02:50.386 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:03:42.793 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:04:30.431 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:04:40.447 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:04:50.463 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:05:00.479 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:05:10.490 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:05:20.507 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:05:30.523 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:05:40.538 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:05:50.556 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:06:00.576 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:06:10.593 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:06:20.612 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:06:30.627 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:06:40.642 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:06:50.660 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:07:00.679 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:07:10.695 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:07:20.710 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:07:30.727 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:07:40.742 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:07:50.759 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:08:00.771 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:08:10.787 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:08:20.804 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:08:30.824 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:08:40.839 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:08:50.856 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:09:00.875 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 2)... 2020-02-17T17:09:10.892 INFO:teuthology.task.internal.lock_machines:waiting for more mira machines to be free (need 2 + 2, have 3)... 2020-02-17T17:09:20.912 DEBUG:teuthology.lock.ops:lock_many request: {'count': 2, 'locked_by': 'scheduled_gregf@teuthology', 'description': '/home/teuthworker/archive/gregf-2020-02-17_05:30:48-rados:monthrash-wip-elector-squash-212-distro-basic-mira/4774532', 'machine_type': 'mira'} 2020-02-17T17:09:20.934 DEBUG:teuthology.lock.ops:locked ubuntu@mira072.front.sepia.ceph.com, ubuntu@mira026.front.sepia.ceph.com 2020-02-17T17:09:21.004 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2020-02-17T17:09:21.196 INFO:teuthology.provision.fog.mira072:Scheduling deploy of ubuntu 18.04 2020-02-17T17:09:21.218 INFO:teuthology.provision.fog.mira026:Scheduling deploy of ubuntu 18.04 2020-02-17T17:09:21.586 INFO:teuthology.orchestra.console:Power off mira072 2020-02-17T17:09:21.586 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H mira072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-02-17T17:09:21.614 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H mira072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-17T17:09:21.634 INFO:teuthology.orchestra.console:Power off mira026 2020-02-17T17:09:21.634 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H mira026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-02-17T17:09:21.658 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H mira026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-17T17:09:21.743 INFO:teuthology.orchestra.console:Power off for mira072 completed 2020-02-17T17:09:21.785 INFO:teuthology.orchestra.console:Power off for mira026 completed 2020-02-17T17:09:21.844 INFO:teuthology.orchestra.console:Power on mira072 2020-02-17T17:09:21.845 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H mira072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-02-17T17:09:21.868 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H mira072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-17T17:09:21.885 INFO:teuthology.orchestra.console:Power on mira026 2020-02-17T17:09:21.886 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H mira026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-02-17T17:09:21.910 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H mira026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-17T17:09:25.898 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H mira072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-17T17:09:25.937 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H mira026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-17T17:09:30.010 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H mira072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-17T17:09:30.048 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H mira026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-17T17:09:30.220 INFO:teuthology.orchestra.console:Power on for mira072 completed 2020-02-17T17:09:30.259 INFO:teuthology.orchestra.console:Power on for mira026 completed 2020-02-17T17:09:30.321 INFO:teuthology.provision.fog.mira072:Waiting for deploy to finish 2020-02-17T17:09:30.360 INFO:teuthology.provision.fog.mira026:Waiting for deploy to finish 2020-02-17T17:12:24.458 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2020-02-17T17:12:24.459 DEBUG:teuthology.task.console_log:Killing console logger for mira026 2020-02-17T17:12:24.459 DEBUG:teuthology.task.console_log:Killing console logger for mira072 2020-02-17T17:12:24.460 DEBUG:teuthology.exit:Finished running handlers